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j. _ r ■ ■ ABSTRACT 

Research reported here is based on the" cognitive mediational 

paradigm for research on teaching,, which postulates that teachers 

influence* students f learning by causing them to think and behave 

in particular ways during teaching. These events may lead to 

changes in out come * variables , such as scores on achievement 

tests,. Hence, the effects of teaching on learning are mediated by 

students' ^behavior and thoughts during instruction, •' 
* . / . 

Four studies are reported.. The first describes five teachers 

and 'their students, and explores in classroom lessons the 

^ * 
cognitive responses students ^report using in response to teaching, 

and the cognitive processes their teachers inLend them ^tq use.. 

The second and' third studies, employ analogs of classroom^ teaching 

in the form of short videotaped lessons* The. objectives of these . 

.studies are to determine if elementary school students could be 

trained to perceive and act on common instructional stimuli and 

whether these operations' would facilitate learning* The fourth 

Study constituted' an extension of the second and third to regular 

classroom environments * * ■ 

Three ma^or conclusions are offered based on the results of 
these studies , First, students and teachers operate in ways that 
reflect the mediating role of students 1 cognition in classroom 
learning* Second, students can be trained to discriminate 
instructional stimuli and to respond with pre-arranged cognitive 
strategies. Third, students* achievement is partly a function of 
the cognitive strategies they activate in response to 
instructional stimuli perceived during teaching. Methodological 
issues attendent to the study of students 1 cognitive processes in 
classroom learning are also discussed. 



11 

ERIC 



CHAPTER^! 



CHAPTER 2 



t;:-iL£ r»F CONTENTS ' 

Ackngv ! 1 ,.„.ent^ . # , , ,* •••C •,«,••*;,. ,, } *>, i 

Ahst? ;m c . - . , ? v e , ii 

List ex'' , .' . . .viii 

List £ M ..art * .......... ; , * . .x 

Con - q of'V 0 " ^ e Tv.- . * *. , , ,*» •••*••»* .XX* 

A P^snitive *?■ h' ".: : " nal Paradigm for . 1 

Rm#*s ■ • ^ on u.li'hi v»g. • • f ««-'»»••. *, I 

r 

1 ./st* ry .......... * 1 

"Oe.. ; ^ ............ 5 

lYfrpl i r. scions for the Project. ••»•*••• 7 

VIABILITY OF TOE COGNITIVE OTBIATIQNAt PARADIGM. » , IT 

The Problem of Students' Cognition, . » - % 13 

Evidence for the Cognitive Med iat tonal 

Paradigm, ......... 14 

/Conclusion. »••••• 19 

Students ' and Teachers' Thoughts about Strategies 
for Learning from Teaching! Study 1.... J. ........ .23 

METHOD* ...................... ^ .................... 27 

Participants. . - * • . 27 

Teachers 27 

Mr. Acton, , * * * . I . . * 27 

. Mr . Anderson • 28 

Mr! Lehmann.. -1 , 29 

Mr, Orr .30 

Mr . Richmond 7 * 31 

, StU denCS* mm mm •*...*• ■ m * m m • *••#• 33 

'Sources of Datai . • , 32 

Videotapes • ... ^ ............. , 32 

Aud iocapes • • • • • .... 32 

Interview Materials - . .32 



Videotaping 

Teacher interview* 

Student interview. . . * . * , 

Transcription of interviews.. 



rftta Analysis , 
"RESULTS 



* • ■ » . 



Or i entm^r 



. m e 4 * 



Affective States 

* Engaganiei, t . . \ . 

Arou ss 1 . # * » * . ... • • * . • * * * ■ i 

Identifying Content , 

.Macroscopic f ocus • , 

Microscopic focut , 

Multiple microscopic items, 

*Cuing Procedures .**.,*,, 

Behavioral interactions**.* 
External procedures* . * , 

Acquiring content , * , , 

Storrng content in memory. s 

Operating* . * . * . * * . * • * .. . . . ... . . . < 



Compar tng.... ...... ...... 

Unspecified comparing. 

Comparing codes* 

Comparilng attributes^, 
Using rules . . # * * 



Generating* * v, 
Generating codes . 
Generating rules. 

Using Met i cognition* 

Monitoring* 

Appraising. ...... 

Consolidating* 

DISCUSSION 

CONCLUSIONS, 



±v 



7 



CHAPTER 3 Training Students to Use Strategic Response's. 

to Videotape Analogs of Classroom Teachings 

S t LJ d Ili.ti<..iit<ii(ittiiirtt|iittiiHllMii''ii » • 8 5 
, I N'T KODUG TI ON . g g m um»»* ■ t i i i • i • ■ t i i i i i • i il I I i i i * i i * ,'8? 

I HOD g . g f. i i • i I t I i i i i ■ i I i I ■ i i » I i * * 89 

participants • • ■ • • % _ .89 

Materials ; ^ .89 

Trs in i.nj^***** ■■■**•»•••■•»•••••• •••mhii***** #90 

Overviews •«.* v 90 

Tra ining group • * • * t • • • » ,91 

Comparison group . , * * * . » - * , # - ,97 

X E r uine Fi G § # * # ^» « * ■ • ■ ■ ■ . ■ * • . ■ . . g ■ * a . * — ■ . 9 7 

Ap t i t Ude # a g . . * • a a g g * * . . g g g g . g g f |l| • I f • • ■ • — .97 

Use of intended cognitive response!,* s 97 . 

, Ach 1 evement 98 
Scoring procedures . g . g .*.* . * .99 

RESULTS AND DISCUSSION. , ¥ _ 100 

* CSVdStS iiii**fit<l!iiiii|«>itiitiitih!ltti|lalOl 

Can Students'Re Trained, to Make Intended 

Cognitive Responses?.**/.*...* lOl 

How Da Intended Cognitive Responses 

Relate to Achievement? . * # . * . , . , # 1 **^ S gi*104 

Do Intended Cognitive Re'sponses ISnJianqs 

Learning from Ins true tibn? * , *, , * * ? t M * * 108 

CONCLUSIONS . g...gggg..gggg.g.ggggggg.giiiitgg»g%^ X 1 3 

J. - - * 

CHAPTER 4 Further Questions About Students' Responses to 

Teaching in Analog Settings? Study III 115 

INTRODUCTION 117 

METHOD ■i(tititiitiiiffiiitiifiiiiiftiiniM!i*i!» 4 20 

# * ■ * h 

Par t i cpan ts 1 20 

Ma t fir t a 1 s ■•••■■■■••***■•••* ■ ••-•*■•* m » • 1 20 

Training.* . * . . . . . • .... . . * * . ....*« . .mm*** » ■ • » 1 20 

'• . . . . • | 




RESULTS AND DISCUSSIONS. 



. * . ,122 



Can Students Be Trained to Mdhe 

Intended Cognitive "Responses? * h m » 
* 

How Do Intended Cognitive Resp<7tties 

Re 1 ate to Achievement?* « 

Do Intended' Cognitive Responses flnhWce 

Learning from Ins true cion? . , # % im, 4 



COIfCLUSIONS TO this powrr. 



a a * * * * # I ,^ ! i { f « « « f w. 4 



* 1 24 

. . .127 

.,,129 
, . ,139 



CHAPTER 5 



Training Students to Respond Strategically 
to Their Teacher's Instruction five 



Classroom Studies! Study TV ii4! ,i 




• * » 






9 ,,147 


INTRODUCTION, , 


* ih t • 








., ,149 


Overview of .the Stud tei - * 


* it* l i * 


« * * 






, , ,153 




* f'lii 


* * * 






', , ,154 


Context i Mr, Forrester-, Class 


^M< i • 








,,.154 


Par tie ipants * •».*.,,,,! w 


* ilh * 


* * * 






,,-154 


Class format 


* Mil! 


* * * 






,,,154 


Context: Mr* Dixon, Class B»,, 


* (Mi> 


* * * 






,,,155 


* Participants ,,*,.,.».,,»*••, 


* f If I • 


* * * 






,,,155 


Class format 




, * * 






, , .156 


Context r Mrs* Christy, Classes 


CD, 








,,,156 


CI ass f otfna t.,, «,,,.,, 


% fill* 


* * * 






,,.157 


Curriculum* 




* * * 




,,,157 



Mapping, 

Generalised Intended Cognitive Response 
(ICR), 



* * , * *» * m f V I i l i * , * , I-*- 



1 • • • e • • *> # * f f 1 1 f , t , i 



* t l f 1 1 1 * « t * 



Training • • • . 

Aptitude Te«4^ P , 
Procedures For pcoring NoteboaKs % • * # % 
Achievement Tests,, 



• * b # i 



t * i \ f 1 1 1 * , » % * % 



,.159 
^163 

,167 
, vT71 

,173 



,17 



-is 



vi 



€> 



RESULTS AND DISCUSSION * 177 

■ ■ ■* 

Can Students Be Trained to Make Intended ■ * 
Cognitive Responses 7 * ;* es I79 

■> 

How Do Intended Cognitive Responses 

Relate to Achievement 7 ,* , 183 



m " » " 
Do Intended Cognitive Responses Enhance t / 

Learning from Instruction 7 ,,,, /, 185 - 



CONCLUSIONS.*. . . . . .221 

6 Conclusions and Implications, 227 

CONCLUSIONS. ........... v*. . . 229 

Problems in Cognitive Mediational Research 9 « s s 233 
Identifying cognitive "mediations . ...... . . ..233 

Tracing cognitive mediations.:......... : 235 ' 

Data analysis ........... 238 

Recapitulation.'. ....... 239 

S IMPLICATION^. ...... . . . T u . . 240 

Implications for Researchers,.,...... 240 

Dependent .variables , 241 

Independent variables , * . 242 

Sunmary * ft . .............. .243 

Implications f or Teacher* Educators . . . 243 

Imp! i c a t i ons * ^p r T eaeners ■"• • • . 244 



) 



247 



vii 

-10 



LIST OF TABLES 



I . Distribution of Students Interviewed in 



* E S Ch ClSSSt'tiiiiiiiiliiiM ||t*ilt(j||titllitfi|f|33 



2 Intended Cognitive Responses in Classroom 

Te a ch i n g ■^■•■••■•■■■■^•••■■•••••••••■•■•••••••^•■•■•■c ^ 5 

3 Means, Standard Deviations and Maximum Scores 
for Behavioral Indications of Intended Cognitive 
Responses for Trained 6 Students , Study II,, 103 

£ Correlations among Behavioral Indicator Scores and. 

Achievement for Trained Students, Study 3 II.,,. 105 

5 Means, Standard Deviations and Correlations 

Among Vocabulary and Ach ievemerit Variables , 
Study II • (,,.■■■..■■••,■•*.■■....'■*.*■**..■*..**..... 109 

§ Backward Selection Regression Analyses, Study II.*.* .110 

7 Time Spent by Groups, Study Tit , 123 

8 Means, Standard Deviations and Maximum Scores 
for Behavioral Indications of Intended Cognitive 
Responses for Students Trained to Use 

Worksheets , Study III ..»,., ,125 

/ 

9 Correlations Among Behavioral Indicator Scores / 
and Achievement for Students Trained to Use *■ / 
Worksheets , Study III ,,,,,, •»..••*• * **,.....,* 128 

; . / 

lOO A. Priori Contrasts Among Groups * / ..131: 

* ■ / 

ll A i Means, Standard Deviations and Correlations / 

Among Vocabulary and Achievement Variables, / 

Study III ,,,****•*,,*••■, *,,,,,,,,,, * • « , ■ , . • , 133 

1 2^2 Backward Selection Regression Analyses, / 

S t Ud III. * * * * ***••, a,, a, * ... * ,, ,,,,,,,,,13 ^ 

?.•;./ 

I^S Summary of Statistically Reliable Results of 

= Backward Selection Regression Analyses, 

Study lit § i § i * « 1 1 » « • • i « i « « > i « . # P i p ( i ( • • j i • i f i • j 1 1 • 1 1 36 

I /mm- Intended Cognitive Responses . . • * ***.,.,.*• 162 

V . • • • ■ /// ' • ' 

* Si^es of Groups Providing Spores Used in 

Analyses, Study IV,, » /• • * **,*.*. *,*.,• 178 

/ 




• i 



1.6 Means, Standard Deviations , and 'trTasti for /? 

■ Scores from Notebooks, Study IV 180 

17 Correlations Between Achievement Scores and 

Notes Scores for all Classes, Study IV * 184 

18 * Means, Standard Deviations, and Correlations 

Among All Variables in Class A, *8tudy IV. 194 

19 Backward Se Action Regression Analyses for 

nla*e A Qf nHv TV ' 196 

\j i £s*£? r\ j i_? w l_l j ^Vp£tt*. ....... 

20 Simplified Regression Equations for Interpreting 

* Interactions from Analyses in CLass A, 1 ■ 

Study IV* J*....**..*.*......**.*...**.*.. *«*******..." 

21 Means, Standard Deviations, and Correlations 

Among all Variables,, in Class B, Study IV. ... .. J . 201 

22 Backward Selection Multiple Regression Analyses 

for Class B, Study IV. • • • • • . * 202 

23 Simplified Regression Equations for Interpreting 
Interactions from Analyses in Class B, Study ,IV. . , * **. 203 

24 Means, Standard Deviations and Correlations 

Among all Variables in CI ss O, s6udy 'IV. 208 

23 Backward Se 1 ec 1 1 on Mu 1 1 i p I e Regression Analyses 

for Class C, Study IV, , . , * . . * . 209 

26 Simplified Regression Equations for Interpreting 

, * Interactions from. Analyses in/Class C, Study IV**... .211 

■ / -J / 1 J J , \ " ' 

27 Means, Standard Deviations and Correlations Among 

All Variables in €l«ss D, Study IV*.. \ <f % • • • 213 

28 /Backward SelectionMul fiple Regression Analyses 

/ for Class D. Study IV. U 214 

/ . 

•* * / * 

29 Simplified Regression^ Equations for Interpreting 
Interactions from Analyses in Class D, Study IV* ***** 215 

■ , /. ■ .• ■ 

30 Means, Standard peviations and Correlations Among 

All Variables in Class's, Study IV * *,*218 

31 Backward Selection Multiple Regression Analyses ' 
for Cl ass E* Study |V. ...•....».***•...•-.*•. •*•*•• , ... 219 

V, 32 Simplified Regression Equations for Interpreting d 

Interactions from Analyses in Class E, Study IV*.*... 220 

33 Summary of Statistically Reliable Terms from 

Backward Selection Multiple Regression Analyses * 
/for All Five Classes, Study IV.. ; 223 



IK 



/ 



12 



ERIC 



LIST OF FIGURES 



FIGURE 

> 

L Student Interview Schedule,,.,,,, 33 

2 Length of Involvement of Each Teacher, Study I ,37 

3 Correspondence of Cognitive Responses to Parts 

of Behavioral Indicator for Varying Instructional 
Events ■•#*...«. 165 



I 

i 

i 

: 



13 



a. 



ERIC 



TABLE OF CONTENTS, VQLDTffi 2 



A^FKNDIX A Curriculum for Studies II and III, 



APPENDIX B illustrative Script Used in Producing 

Videotape Lessons^ for .Studies II and .III, 



. 73 



APPENDIX C Scripts Used in Training Group, Study II 81 



APPENDIX D Essay and Multiple-Choice Tests for Studies 
1 1 and III^fiBiiiiiiiiii ■ , .» 



135 



APPENDIX E 

V 

APPENDIX F 



Scoring Keys for Multiple^Ohoice and Essay 
Tests, Studies TI and III***,,,,,,*,,....., 



ICR Aptitude and Achievement Measures for 
Class A, Study TV * ,,,,*,.,,.*, 



157 



189; 



APPENDIX G ICR Aptitude and Achievement Measures for 

Class H , Study TV ,*,.*** s s *** 235 



APFENDIX H ICR Aptitude and Achievement Measures for 
Class D , and E , JStudy TV. ............. . 



...277 



4 



xi 



14 



CHAPTER 1 



A Cogn^ ve Medi'ati onal Paradigm 

Por Research on Teaching 



15 



CHAPTER 1 



A Cognitive Medlational Paradigm 
for- Research on teaching 

TNTROBTTCTTGN 

Karly History 

In 1897^ Joseph Rice surprised the world of educational 
research ch his report o^ an extensive survey that documented 
the lack of relation between the amount of time students spent In 
spelling drill and the!^ spell inf achievement. His publication 
was significant In two ways. First* it demonstrated that 
propositions about teaching could he potent influences on both 
theory and practice when they Were supported by systematic 
^empirical investigation as opposed to merely individualistic raw 
experience, Wh^l e rational and emotional arguments were leveled 
against Rice's Finding, there nonetheless was a robustness to his 
claims that* was unmatched in earlier and more numerous personal 
accounts about instructional effects, Fmpirieal methods became 
solidly established as means ^or investigating teaching and for 
supporting positions about teaching effectiveness. 

The second malar impact of Rice's article was to raise the 
question of why a well -respected and widely practiced teaching 
method did not produce 1 eve Is of achievement that were believed to 
be the Inexorable product of such teaching* That an expected 
effect was not observed in data opened up further issues regarding 
the epistemol og1 eal status of then contemporary conceptions of 
teaching and methodologies for promoting knowledge about teaching* 

Tn the six decades that followed R1ee f s seminal paper, 
empirical research that explored relations among aspects of 
teaching and learning was fundamental Iv utilitarian. Though many 
researchers asked why certain instructional practices might 
influence .students' learning, the research was fundamental 1 y a 
trlal-and-error search for anv socially permissabl e teaching 
practice that fostered students' achievement. Though a causal 



theory linking teaching to students 1 achievprnent was what 
rasearchers sought, the dominant empirical met hod was 
correlational* This search for teacher ef f ec t i vaness , 
irrespective of why such effectiveness should he observed ? held 
"almost complete dominion over the conceptions that most 
researchers brought to /the field 11 CHage, 19fi3, p, 114"), 

Reviews of the many investigations In this tradition Were 
less than positive* The sought-after causal relations between 
teachers* acts and student achievement general 1 v were unreliable, 
weakj and perhaps most disturbingly, sometimes eoritrary to •<■ 
overpowering commitments about what teaching shou 1 d be like fsee 
Dunkin & Blddle, 1^74)* For example * Anderson T s n meticulous 
'analysis, of the studies about, teachers* styles of leadership as 
potential determinants of students" attitudes and achievement 
eroded scientific support for a hi ghl y=va Hied position many 
educational ists held abqut the superiority of democratic teaching 
styles, A tenable conclusion in the late 1950s was that research 
on teaching had been generally unl nf ormati ve about teaching 
ef f ect 1 veness % and that the basis o^ knowledge It claimed could 
promise little for the future* 

Not all researchers - f howeveV s allowed this growing despair 
about the limited results and seeming vai uel essness of research on 
teaching to incapacitate their search for understanding that might 
lead to better teaching practice „ Two ma lor devel opments, appeared 

in the 1950s and early 1960s that foul d sustain both researchers 

y 

and consumers of research on teaching, T he fi^st of these was to 
dominate the next 15 years of the field's growths The second, 
while often talked of and approached, wou^d prove much more 
el us* ve- 
in sharp reaction' to the widespread characterisation of 
instructional events as molar or global , as was evident in 
descriptions of leadership styles or discovery strategies for 
teaching^ researchers of the 1 9fi0s and early 1970s turned toward 
precise behavioral specifications of what teachers and students 
did in classrooms. Flanders' (I960, 1 963) Bel lack, Hyman, 

Rmlth, and Kllehard's 0 966) systems for eategprlzing behavioral 



interact* ons fn teaching were representative of an emerging 
movement bwar^ specificity i n the way researchers cataloged 
variables that might ^nHex teaching effectiveness. By 1967, Simon 
and Boyer were ah 1 e to collect nearly 70 different i nstruments for 
ohservfne cl assroom- interact! on, Shortly thereafter, Rosenshlne 
and Furst H 973^ conservatively estimated the number of such 
systems to he i'n the hundreds* The d* recti ons suggested by 
behavioral observation sti 1 ! dominate much current research (e,g*, 
Gage, 1078; Ryan et al . , 1 Q82 ; Winne & Marx, 1977), . 

Complementing this more fine-grained view of teaching events 
was a surge in questions raised about why and how discrete teacher 
behaviors could affect students* achievement, Two events in 
particular seem to have been malor contributors to the emergence 
and eventual prominence of calls for theories of teaching* The 
first was a gathering of educational and psychological researchers 
that led ultimately to the Taxonomy of Educational Objectives 
(Bloom, Engelhart, Furst, Hill, & Krathwohl , 1956V This taxonomy 
provided researchers with a greater degree of specificity than was 
available previously for describing students* learning. This 
system complemented the growing precision of systems for observing 
classroom interaction. But this was not the most prominent effect 
of the Taxonomy , 

The psychological language used in the Taxonomy to describe 
categories of learning practical iv begged* researchers to insert 
into their models of teaching descriptions about how students 
would respond cognitively to instructional events, For instance, 
teachers 1 questions were classified into hierarchies based on 
claims ahelit how students responded cognitively to teachers* 
questions f e „ g. , Aschner, Gallagher, Ferry, Afsar, Jenne , & Faar , 
1965). The use of language from the taxonomy clearly invited 
researchers to spec il at^ about how students* cognitive responses 
to specific teacher behaviors during teaching might promote or 
inhibit acts of learning and the products of these acts, Since 
these cognitive mediators of instructional events were theoretical 
constructs, their inclusion in models of teaching effectiveness 
brought concerns for theory into direct contact with commitment- 



laden research efforts (Dunkin & Biddle, 1974^ Researchers now 
had a language for describing teaching that was paralleled at 
least partly by theories of learning* Though distant from 
classroom teaching in many ways, this ! infusion of psychological 
jargon Into research on teaching provided 'a foundation for 
generating theoretical explanations of teaching effectiveness 
based on behavioral' analyses of teachers 1 and students' verbal 
activities during teaching. 

The availability of theoretical concepts that the Taxonomy 
provided may not have been, by itself, a sufficient catalyst for 
researchers to create and test theories of teaching in research. 
What seems to have insured t%at researchers would attempt to use 
theory in their research were compelling arguments made by Gage 
(1963, 1964) in the Handbook ^of Research on teaching and in the 
widely circulated National Society for the Study of Education 
* yearbook titled Theories of Learning and Tns tract ion . In 
proposing a logical division between theories of learning and 
nascent theories of teaching, Gage gave stature and credibility to 
research* on .teaching that availed itself of theory* 

In a context of growing support for research in the form of 
grants and contracts^ and rising calls for better education 
emanating from a rekindled social conscience, theories of teaching 
were seen as a social necessity and a logical next step for many 
of the various theories of learning developed by psychologists 
(see Hilgard, 1956), As Gage (1964,, p* 271) saw it^ 

Much of our knowledge about learning can be put into 
practice only by teachers, And the ways which these 
teachers would put this knowledge into effect 
constitute part of the subject of theories of 
.teaching. Our position is that practical applications 
have not been gleaned from theories of learning 
because theories of teaching .have hot been developed 
,,,, Theories of teaching and the empirical study of 
""^teaching may enable us to make better use of our 
knowledge about learning* 

Having shifted from molar to molecular analyses of behavioral 
events in teaching, and having adopted a strong psychological 
orientation as. a basis for explaining effects of teaching, the 
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next decade and a half would see researchers focus on generating 
theory in research on teaching. 
The 1970s * 

Precise specifications of teacher-student verbal interactions 
on the one hand, and attempts jtp^enerace and test 
psycho 1 ogl cat 1 y-ref erenced theoreti cat proposl ti one about cause- 
effect relations In teaching on the other hand, received much 
attention in the research of 1 the 1970s* The former reached an 
apex of devel o^menC_1 n the performance— based teacher education 
movement (see Gage & Winne f . 1 $75^ • The latter remained, for the 
most part, rhetorical. 

Tn their extensive review of classroom-based research on 
teaching that covered roughly the period of the Tate 1 ^60s and 
very early 1970s, tfunkin and Bldd^e (1974, p. 425^ characterized 
the field's greatest problem as a 8 *lack of adequate theories of 
teaching that would integrate and explain its ma/Jor findings,* 0 In 
reports of studies, most researchers Indeed offered nascent i 
thepreticaT proDositlons about teaching effectiveness* Rarely, 
however, were studies designed in such a wayS^s to test one or 
another psychologically oriented theory* As a result, only 
Infrequently were data generated from research on which to base 
strong theoretical propositions. The end of the 1970s was marked 
significantly by the absence of the theories called for earlier by 
Gage, and more recently by Dun kin and Fiddle* Although the edited 
volume Research on Teaching ( Peterson & Walberg, 1979) offered 
several chapters that suggested routes to follow in developing, 
theoretical structures, the contributors to this volume did not 
yet have the resources to achieve the goal set for the field 
nearly 20 years earlier. 

Research on teaching, however, has not stagnated* The malor 
developments In research on teaching during the decade of the 
seventies were methodological and metatheoretl cal * Tn a chapter 
entitled "Theory Construction for Research on Teaching** , Snow 
(1Q7^) tackled directly the task of developing theories for the 
field* In a second paper (Snow, 1 974^ , he made several sage 
points for improving genera 1 methodo-logv in experimental research 
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on teaching* One of the manor contributions Snow made in his "J 97£ 
paper extended and elaborated a theme he dealt with in an earner 
paper C Snow , 1968), namely, a concern for Improving the external 
validity of experiments on teaching hv u.qing Representative 
designs." In his words ( Snow, 1974, p. "the biggest 

threat to external validity may come when the experiment does not 
fit the nature of the behavior being studied and* furthermore, 
does not include the means for discovering this fact." Since 
teaching is an activity that takes place In an 1 nf ormat 1 onal 1 y 
rieh ¥ aifr>1 guous and redundant environment, experiments must 
representative of this context if thev are to inform theory that 
can be not only descriptive, hut prescriptive as well. Snow's 



efforts were followed hy more subs tant * ve*iy s peel fi c work by 
Berliner (1976), Winne/ : and Marx (1 977), and Doyle (1978), 

Beyond criticisms of prior research, these papers provided 
concepts and principles that could serve as stepping stones for 
conceiving, conducting, analysing, and interpreting research on 
teaching* Tn his summary o? "Impediments to the Study of Teacher 
Effectiveness," Berliner (1Q76) highlighted a number of concerns 
he had for Improving the quality of research within the process^ 
product paradigm* Among general concerns, for statistica 1 
analysis, the nature of instruments rhat could document the status 
of independent and dependent vaf^abl es t and methodological 
problems regarding issues such as internal validity* he Included a 
section on the mediation of teacher effectiveness through student 
behavior* Two basic messages appeared in this section. The first 
was that "We are now convinced that the mediating link so 
necessary to consider is a student's active time~on-task" 
f Berliner, 1976, p. 10) and that "some variables thought to he 
quite important by educational theorists are in fact unimportant 
to, unpercelved, or unparcelable by students* 1 (Berliner, 1976, p* 
11). In our view, the latter question ^s a theoretically richer 
formulation of the farmer. Gage (1978, p. 76) put it this way: 
"Academic learning time. In the form of allocated and engaged 
time, is, in a sense, a psychologically emptv quantitative 
concept* We need better analyses of how that time 1s filled, of 



what learning ^processes go on during academic 1 earning time, " 
Tmpl i cat Ions For the Project * 

This brief history of research on teaching highlights several 
kev, aspects re^ard^n? the current status of theories of* and 
research on, teaching- First, there is now full agreement that 
systemati c empi ri cal methods are essential if research is to 
provide data from which theories can he created* tested, and 
revised. 

Also, there is widespread* hut not complete* agreement that 
relatively precise ana 1 vses of the behavioral environment of 
teaching are appropriate for this task Ccf* Bronf enhrenner , 
1976), Third, theories of learning provide a promising point of 
departure for the development of theories of teaching, though' we 
believe that these are hut one family of theories that will - prove * 
useful (e*g,, see also Hall & Gall* 19-7-5). Finally* there is a 
recent but nonetheless forceful call for r.heory-ori ented research 
to he conducted in a manner tbat represents rather than distorts 
the phenomena Interest fRnow, 1^73)^ 

Not all Intel iectuai devel opments achieved in this history 
were without cost, however. Tn particular, Gage's call for links 
between theories of learning and theories of teaching* have not 
yielded well-articulated* empirical ties between the two varieties 
of theories. Rarely has" fc research on teaching been used as a basis 
for generating or altering propositions contained within theories 
of learning, And* bevond a fast-developing theory of learning 
outcomes and procedures for testing them fsee Gagne & Beard, 
1Q78) , little empirical verification can be found for descriptions 
of how instructional events bring about student' learning in terms 
of theories of learning fWinne" & Marx, 1^77* Winne, 1982b), 

The cost to theories of teaching wrought through previous 
attempts to loin them with theories of learning has been one of 
losing sight of fully one-half of the unit that must be considered 
in the teaching-learning process, Specifically, sets of "teacher 
should" principles fGage, 1 980) comprising contemporary 
prescriptive theories of teaching speak only of the teacher* They 
ignore the psychological context .within which the effects of 



teaching occur, namely, the everpresent chinking in which students 
engage as they are attempting to make sense of and respond to the 
instructional activities orchestrated by the teacher (Wi nne & 
Marx, 1979). At present, the box that frames students 1 cognitive 
activities during teaching is relatively empty Ccf. Winne, 1983c), 

Recently the process-product paradigm for research on 
teaching as described here has undergone .a logical revision. 
Notable among updates to this paradigm are what Doyle (1980) calls 
the "mediating process paradigm," or what Winne H982^ refers to 
as the "cognitive mediational paradigm," 3oth views postulate 
that teachers do not directly influence student product variables, 
such as achievement, Rather, teachers influence students by 
causing them to think and behave in particular ways during the 
course of teaching* These i ntra^ins true ti onal events, in turn, 
may lead to changes in outcome variables* Hence, the effects of 
teaching on learning are mediated by students' behaviors and 
cognitive processing during instruction* 

The cognitive mediational paradigm opens up to question the 
match between researchers' hypotheses about how learners react 
mentally to teaching events and the ways learners actually process 
information cognitive! y in classrooms. For example, consider a 
teacher asking an application question during instruction 
^(Hunkins, 1972)* Although such teaching events can be observed 
reliably in terms of their surface behavioral characteri stTrtri, 
characterizing students 1 cognitive responses to them raises 
crucial issues. If students fail to demonstrate mastery of the 
content called for by an application question on an achievement 
test, or if they do not use the process of application with new 
curricul^r content f researchers usually concluded that the - 
teacher's application questions did not promote learning. 
Researchers* reasoning about this chain of events, however, has 
not included an empirical test of whether, during teaching, 
students ever engaged in the psychologica; processes that 
researchers assume to accompany application- questions, Without 
such data to document students* mediations of the teacher's 
questions or other supposedly instructional events, descriptions 



about how instructional vani ahi es affect students' psychological 
processing Information, and ultimately their achievement, are 
fundamentally speculative. * 

FaH ins to document that students use the parti ediar 
cognitive responses researchers associate with a jgi ven 
Instructional variable allows several s rival hypotheses to be 
proposed when treatments fail to affect students* learning 
positively (Winne, 1979, 19&2a). Consider again the f case of a 
teacher asking an appl i cation question where some students do not 
demonstrate achievement on a test i=tem that Is directly related to 
the answer of #the question asked ^n class, First* although the 
teacher's application question was apparent to # a researcher , some 
students may not have been attending to the teacher at that 
point, Tn effect* these students do not experience the 
Instructional event, Another possibility Is that students may 
have heard the question, but may not have understood how to 
respond coRn^tlvely to 1 t beause'the cognitive processes the 
teacher intended were not communicated clearly, .Other students 
may have beard the quest! onTnd understood the kind of cognition 
intended by it, but may have lacked either the required knowledge 
to insert 4 nto cotnl tl ve processes or the ability to draw on 
cognitive processes perceived to be the kind the teacher 
Intended, For these student's, the application question could not 
function as the teacher , or the researcher, intended, A fourth 
possibility is that some students noticed, understood , and were 
able to carry out the cognitive work to answer the teacher's 
application question but, fon some reason, chose not to do it* 
These students lacked motivation or thought they knew a better way 
to reach an answer to the question, Tf each of these four 
possibilities characterized only two or three students in a class, 
at least one-third of the class would not he eognitively 
responding to the application question *n a way theorized by the 
researcher or Intended ^hy the teacher, A recent study by Dillon 
CI 982) empirically confirms that, at least for each single student?^ 
who does provide an overt, observable answer to a teacher's 
question, the odds are 50-50 that the answer reflects cognition 



attributed to the question by the researcher. Thus, it would not 
be surprising that some students failed to learn what was 
expected, or that mean achievement in such a class was not higher 
than a comparison class which was not asked application questions 
(Winne, 1979). 

We postulate that some teacher behaviors directly influence 
students 1 cognitive processing of content during Reaching. These 
cognitive processes, in turn, determine whether students learn in 
accord with teachers 1 intentions and researchers 1 models of how 
learning takes place* Since these cognitive responses are central 
in determining "what is processed , how it is processed, and 
therefore what is remembered" (Rothkopf, 1976, p, 116), they are 
essential elements in theories of teaching and in research derived 
from these theories, 

Tf the cogftitive mediational model is correct, research on 
how teaching affects learning will need /to change, Specifically, 
in many previous investigations researchers have stressed teacher 
behaviors and, to a slightly lesser extent* student behaviors* 
Both were treated as direct causes of students 1 learning, The 
cognitive mediational model will require thrfc^ research explore how 
students perceive learning tasks (Weinstein, in press; Winne & 
Marx* 1979) and what they do cogni tively to bring about learning 
based on these perceptions. Such research also would need to link 
teachers* decisions about how they intend to direct the cognitive 
processing students should use to learn from teaching OShavelson, 
1981), teacher behaviors that communicate these intentions to 
students (Peterson* Swing, Braverman & Buss, 1982), students 1 ^ 
perceptions and use of cognitive processes to learn from teaching 
(Marx* Winne, & Howard, 1982), and students 1 behaviors. that inform 
teachers how well students are progressing (Marx, 1978), ^ 

Rich theories and their attendant bodies of empirical 
findings ejiist to help fill these lacunae. They exist partly in 
the literature on the psychology of learning* Along with ^ge and 
others (e.g.* Calfee, 1981f Doyle, 1978, 1980^ we think it 
necessary to draw upon this literature, specifically the 
burgeoning research and theories of cognitive learning, to inform 



^and enrich cheon'es of teaching. To do this so as to advance 
prescriptive instructional theory, we a 1 so believe that research 
questions must be cast and methodologies must he developed in the 
spirit of Snow's (\ 974) cat] for representative designs But, 
before this research * s begun, it should be documented that the t 
cognitive mediational paradigm is worth pursuing. We turn to this 
task in the next section. 

Vt ABILITY OF THE COGNITIVE ME DT AT TONAL PARADIGM 

The jraodels that guided research on teaching over the last few 

decades have undergone significant transition,. In the last 

section we provided an overview of changes regarding the adoption 

of empirical methods, the sharpening of focus for viewing teaching 

events, the call 'for links to theories of learning* the argument 

f or representati ve methodoiosv f and attempts to Integrate these to 

build foundations for generating theories about teaching. In this 

section, we present a more detailed picture of the transition from 

a process-product paradigm that characterised the, vast majority of 

previous research on teaching to a cognitive mediational 

paradigm* T Ms newer paradigm elaborates and focuses more 

i- 

precisely on questions about rel at i onships. among Instructional 
events in classrooms, and students' achievement by making use of 
theories of learning* 

Research on teaching conducted in the last two decades was 
strongly influenced by conceptions put forth in the Handbook of 
Research on Teaching (Gage* 1963)* Doyle H 978) recently 
summarized the process^product paradigm that characterized a 
synthesis of those views* Essentially, this paradigm was 
concerned with predicting the degree to which particular teaching 
events would correlate with, and ultimately control, the products 
of teaching defined as students' attitudes and achievement* But, 
as we demonstrated In the previous section, this focus on teacher 
behaviors delivered during instruction and measures of student 
learning obtained after instruction has begged the question about 
the psychological responses students made to teaching during 
instruction. 



The influence of methodological behaviorism (eg*, Skinner, 
1953) helped remediate this deficiency by encouraging researchers 
to document more precisely the behaviors in which students engaged 
during lessons. Thus, some observation instruments employed in 
process=produet research on teaching began to catalog both teacher 
and student behaviors in the context of teaching, But, very 
little data has accrued that has validly linked students' 
behaviors to the cognitive processes that researchers favored as 
the explanatory mechanisms to account for teaching effects. 

As proeess^produet research began to yield findings that 
violated reseirchers 1 commitments to speculative psychological 
mechanisms linking behavioral events in the classroom to tudents' 
subsequent achievement, questions were raised about whether the 
process-product paradign could illuminate the means by which 
students* achievement might be influenced during teaching, Doyle 
(1978) and Wlnne and Marx 0977) summarised these questions In 
their reviews of research up to that time. Doyle focused 
fundamentally on the three paradigms labelled process-product, 
mediating process* and ecological, Winne and Marx argued for 
including in research on teaching perspectives that took into 
account teachers 1 cognitive processing, students' cognitive 
processing, and bidirectional behavioral interactions that were 
the medium for teachers and students to communicate about 
cognitive processing students could use to learn from teaching, 

Boyle*© and Wlnne and Marx's characterizations of 
deficiencies in prior research on teaching raised questions about 
how validly behavioral events occurring in. cl ass rooms were mapped 
onto theoretical constructs which these behavioral events were 
believed to entail* For example, in his discussion of the 
mediation of teacher effects through student behavior, Berliner 
(1976, p, 10) stated that "intermediate links in the causal flow 
(between teacher behavior, students* cognitive processing, and 
subsequent learning) require us to examine the students' attending 
and inf ormation^processing behavior," In other words, the 
process-product paradigm was not representative of the range of 
phenomena that characterize teaching and learning, "Information 
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about students fwas) confined primarilv to scores on pre- test and 
post-test achievement measures, Kven when data about students 
classroom behaviors are available* the tendency in the past has 
been to deemphasi ze this evidence in interpreting findings" 
(Doyle, 1978, p. 167). 
The Problem of Students' Cognitions 

Having raised the question about the role of students' 
cognitive processing in learning from teaching, there still 
remained considerable work to be done to focus this question and 
to generate methodologies for investigating phenomena related to 
it. In approaching these two objectives, considerable light was 
shed on the difficulties which plagued research on teaching 
conducted under the guidance of the process— product paradigm* 

The fact that researchers had to ask the question of how 
students respond eogn*tively to .teaching events suggests that they 
had been overly optimisti c* * n assuming an isomorphism between the 
ways in which thev tbougbt learners were reacting mentally to 
^teaching events and the wavs in which learners were actually 
thinking in ~ H classrooms * 

It is not surprising that students' achievement failed to 
develop as expected if thev had not engaged in the cognitive 
processes researchers were attempting to promote by teachers' use 
of different teaching behaviors. These same cognitive processes, 
however, constituted the foundation on which researchers were 
attempting to create theories of teaching, Vhen a researcher's 
assumptions about the occurrence of these processes does not 
correspond to their qctual use by students, theories of teaching 
necessarily will suffer from a lack of construct validity of 
treatments fCook & Campbell, 1 979) . This was what plagued 
research that grew out of the proeess^product paradigm* But, a 
logical argument about the medlational role of students* cognitive 
processes in 1 earn Irig *f rom teaching is not sufficient for adopting 
the cognitive mediational naradigm, Empirical questions remain as 
to whether these phenomena exist and whether their importance can 
he demonstrated* 
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Evidence for the Cognitive Mediational Paradigm 

In order for the foregoing argument about the mediational 
role of students * cognitive processes to be supported empirically f 
it is necessary to demonstrate at least four^ things. First, there 
is no doubt that students can learn from teaching as presently 
delivered in classrooms, Tn addition, a fundamental assumption of 
cognitive psychology is that learners actively construct mental^ 
representations of their environment, rather than passively react 
it. Presumably, in an environment such as a classroom where the 
activities are purposive, this active construction of knowledge 
and skills is Bounded by the goals of instruction. That is, one 
would not expect learners to construct cognitive representations 
of the content of instruction that are not in some way related to 
the teacher's presentation of this information. Thus, a first 
necessary condition for accepting the validity of the mediating 
process paradigm is that students perceive the occurrence of 
specific instructional events, If such perceptions are not 
attained, then it would be unlikely that students would engage In 
the deliberate use of cognitive processes that the teacher 
intended in response to these events, 

Many areas of research about teaching provide evidence that 
students, notice discrete teacher behaviors, in a highly 
controlled experiment on the effects of teachers 1 use of 
structuring, soliciting, and reacting behaviors, Winne ( 1 977 i see 
also, Clark* Gage, Marx , "Peterson , Stayrook, Winne, 1979) used 
aptitude-treatment interaction methodology to examine aptitudes 
related to whether students attended to their teacher's use of 
these behaviors. There was clear evidence that students' 
attention, to teacher behaviors rhat made up the experimental 
treatment were^ associated with the actual occurrence of those 
events and with students 1 aptitudes. For example, with respect to 
a cluster of interrelated teacher behaviors constituting the 
dimension of reacting, students* attitude toward the subject 
matter, their general ability, and the actual degree to which the 
teacher engaged in reacting behaviors predicted the extent to 
which students characterized their teacher as having used these 



29 



teacher behaviors* T hus f Winne found chat, in addition to the 
actual teacher behaviors used duHng Instruction, students' 
perception of the occurrence of those Instructional events during 
teaching was associated with their aptitudes, 

Tn another context, Weinstein, MiddlesEadt, Brattesani, and 
Marshall O documented that students perceived their teaeher 
to use several specific teacher behavior variables differentially 
when interacting with high and low achieving students . For 
example, students indicated that s relative to high achievers, low 
achievers tended to be the recipients of negative Feedback and to 
be directed more by the teacher while performing their classroom 
activities. Also, high achievers were judged by students to be 
given more choices while accomplishing; their academic tasks, and 
to receive statements hv the teacher indicating that more was 
expected of them in academic performance* 

Tn contrast to Winne's n q 77> study, this one suggested that 
students also can perceive the existence of relatively global 
teacher behaviors in the context of teaching. These two studies 
jointly illustrate that students do attend to occurrences of 
particular teacher behaviors during instruction. The fact that 
Winne found students could reeogni m ^the occurrence of specific 
behaviors embedded in a large facet of teaching suggests that 
students may be able to .oerceive both discrete events as well as 
clusters of related activities in teaching. That students* 
aptitudes influenced the degree to which they noticed these events 
suggests that conditions under which students may notice these 
events could vary, The study by Weinstetn et al* documented that 
students also can perceive global characteristics of classroom 
teaching- Thus, the leve 1 or complexity of teaeher behaviors 
investigated by the mediating process paradigm probably can span 
the range of instructional events currently being researched in 
the field of teaching effects, 

A second -necessary question to be asked of the mediating 
process paradigm is whether students f perception of the occurrence 
of teacher behaviors actuary relates to their subsequent 
achievement, A study by Stayrook, Corno, and Winne O 978> 
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provides evidence on this point- Using part ot the daEa ftOn, 
Winne (1977) and Clark et al. (1979) s path-analysis techniques 
were used to analyse the links between students 1 aptitudes, 
manipulated occurrences of specific teacher behaviors, students' 
perceptions of the occurrence of those teacher behaviors, and 
subsequent student achievement, St ay "rook et al. found that, 
-beyond- the efferts that students 1 aptitude and teachers * ac tual 
use of specific teacher behaviors had on subsequent learning, 
students* perceptions of the occurrence of particular teacher 
behaviors also were directly linked to their levels of 
achievement* Stayrook et al. noted that ,! the mediating effect of 
student perceptions may be behavior-spec i fic P For structuring and 
reacting, it seems that such perceptions do act as mediating 
variables, but this is not the case for sol ici ting" (Stayrook et 
al., 1978, p. 55). 

This study is important, in two respects*. First, it provides 
evidence that students 1 perceptions of the occurrence of teacher 
behaviors can be related to achievement measured at a Later point 
in time after teaching is over, Additionally, the study also© 
documented that the link between students 1 perceptions of* 
particular teacher behaviors and their subsequent achievement may 
vary for different kinds of teacher behaviors. Descriptions of 
the nature of this variation constitute an important goal for 
research guided by the mediating process paradigm. 

The third key question with which the mediating process 
paradigm must wrestle is whether students understand that a 
teaching event is intended to engage them in one, as opposed to 
another , particular cognitive process, If students attend to 
particular teacher behaviors, and if these perceptions are related 
to achievement, it still remains to be demonstrated that students 
engage- particular cognitive processes in response to teacher 
behaviors, Studies by M6rine-*Bershimer and" her colleagues 
(Morine-Dershimer , 1982; Morine-Dershimer S Fagal , 1980) provide 
some evidence on this point. 

These researchers videotaped students participating in shorty 
lessons* Using the videotape as a stimulus to cue recall, they 
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interviewed the students about their parti e1 pat 1 on In the 
lessons. The students* responses to queries about the functions 
of teachers' questions were categorized according to what the 
students understood about whv the teacher was asking particular 
questions* For example, 36% of the teacher's questions about 
which students were asked in these Interviews were classified hy 
the students as providing an opportunity for the teacher to_ teach 
further information wh^e students were responding, To speculate 
on the cognitive processes students might believe were intended In 
this context, students might believe that questions were Intended 
to create for them a set to he used for receiving Information 
following the question itself* 

Students were also asked about nWeir understanding of the 
functions of praise, Tn 59% of these incidents, it was reported 
that the teacher's use of praise indicated that a student had a 
correct response or a good idea* Again, speculating on cognitive 
processes that students might use In this context, praise could be 
a signal either to store in memory the Immediately preceding idea, 
since praise cued its importance, or to Identify It in some 
special way because it would be useful -later in the lesson* Tn 
either case, from the 'point of view of the cognitive processing of 
students, praise can be seen as carrying inf ormationfl 1 value as 
much as, if not more than, carrying motivational va 1 w f, 
Brophy, 1981), 

Tn addition to other findings in these studies ^ there exists 
evidence that students infer meaning for their cognitive 
processing rfs a function of the occurrence of particular kinds of 
teacher behaviors. However, there still remains a fourtji question 
which must he asked in the context of the mediating process 
paradigm tn order to accept It as an appropriate characterisation 
of students* learning from teaching. tf students attend to the 
existence of teacher behaviors, If their perception of these 
behaviors is related to achievement, and furthermore if students 
interpret these behaviors as signals that certain- cognitive 
processes be engaged, one still must be able to demonstrate that 
when all three of these events occur, learning can be influenced 



when students* cognitive processing * s con^oUed in response to 
teacher behaviors. The issue here is whether students* cognitive 
processing of content, when cued by teacher behaviors, can become 
an independent variable 1 n research on teaching. This is 
essential In order to propose and test theoretical claims about 
causal links between students* medi at Ing cogni El ve responses to 
teacher behaviors and students' achievement. 

Three studies can be cited that provide preliminary evidence 
that the answer to this question is affirmative. Koopman and 
Newtson (1981) performed an experiment in which they instructed 
university students viewing a videotaped lesson to focus either on 
the sum! lest steps of the 1 esson that seemed natural and 
meaningful to them, or the largest steps of the lesson that seemed 
natural and meaningful. These researchers attempted to control 
participants* perception of the videotaped teacher's behavior by 
instructing them to focus at either an atomic or a molar level, 
Koopman and Newtson found that these simple instructions affected 
the participants 1 description of the Instruction, Thus, students 
watching a videotape as if thev were participants in a lesson were 
able to control the level at which thev attended to teacher 
behaviors. Also, there was an indication that lessons which 
encouraged relatively atomic perceptual analysis produced greater 
learning than lessons that encouraged more molar analysis, 
Overall* then* these findings suggest that, not on! v is it 
possible for students to control their attention to teacher 
behaviors, but that certain kinds of cognitive responses to 
teaching are associated with achievement. However t since this was 
an analogue study rather than a direct test of an instructional 
effects it failed to document a el ear relationship between 
manipulating students 1 cognitive processing in response to teacher 
behaviors and subsequent learning. 

Two other studies demonstrated that ft is possible to 
Influence students' cognitive processing in response to 
instructional cues, and that such Influence affects subsequent 
achievement. In a study using university students In a lecture 
situationi Winne and Marx fl9801 successful 1y instructed students 
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Co make specific cognitive responses to the occurrence of specific 
lecturer behaviors (e.g., giving a new example of a concept). 
Contrary to expectations, attempting to change these relatively 
sophisticated learners 1 cognitive responses to events during a 
lecture interfered with learning rather than facilitated it* 
Though the observed effects of training on students V achievement 
were in a direction opposite to the hypothesis, this study 
nonetheless provides evidence that it is possible to control 
students' cognitive responses to teacher behaviors, and that such 
control does influence learning, 

A later study by Winne (1982b) attempted to correct several 
of the flaws in the preceding experiment. By providing students 
greater practice in the cognitive responses to particular 
instructional stimuli j he reasoned that students would be able to 
execute them relatively expertly. Using upper elementary students 
who read a text augmented with either instructional objectives or 
adjunct questions, Winne found chat it was relatively easy to 
instruct learners to make particular cognitive responses to these 
text-based instructional stimuli. Using aptitude-treatment 
interaction analyses, he also found that training students to use 
cognitive responses upon encountering instructional objectives 
before reading a text interacted with students 1 general ability. 
Achievement was enhanced for low ability students who received 
direct instruction about the cognitive responses to make in 
response to instructional objectives, The general conclusion 
drawn by Winne was that students could be trained to make specific 
responses to instructional stimuli, and that, with respect to 
subsequent achievement their prior aptitudes sometimes influenced 
the effects of such control over their cognitive responses. 
Conclusion 

The foregoing brief review of illustrative studies shows that 
all four empirical questions that must be asked of the cognitive 
mediations! paradigm can be answered affirmatively. Thus, there 
is empirical evidence to support the proposition that research in 
the service of theories of tenching can be linked to theories of 
learning by focusing on the cognitive responses that students make 
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CO teacher behaviors. Given the logical argument and the 
available empirl eal evidence iustlfying the viaMHtv of the 
cognitive med tat tonal paradigm* we indeed that an exploration of 
teaching as mediated by students' cognitions was appropriate, 

The series of studies undertaken In this prelect focused on 
several issues. Firsts what intentions do teachers hold for their 
students * thinking during instruction^ What Is the range of these 
cognitive processes and how do teachers working in their 
classrooms communicate these intentions to their students 9 
Second^ what teacher behaviors do students perceive as conveying 
information about how to think during teaching, and how do thev 
interpret these signals^ Third, can students be taught to 
perceive pre-arranged signals in teachers' behavior that 
communicate intentions for student thinking, and to carry out 
particular cognitive learning strategies as responses to these 
signals In the context of classroom teaching? 

We approached these three questions in a series of studies 
that began by studying natural teaching in intact elementary 
school classrooms* Our ohlectlves for this first study were to 
document teachers' views and students' views about teaching as a 
means for influencing students' cognitive processing of curricular 
content, In particular, we asked teachers to describe the 
intentions they had for students' cognitive processing at varying 
points in lessons, and to identify the behaviors thev used to 
communicate these* 1 ntenti ons to their students* Then, to cross- 
validate and extend the picture of students' cognitive mediation 
of teaching as-" painted by teachers , we interviewed students to 
discover whether they were aware of the behavior that their 
teachers had described, and whether their understanding about how 
curriculum was to be processed ^cognitive! y matched the teachers' 
intentions, In addition, we sought to identify conditions of 
teaching and of students* cognition that Influenced the degree to 
which students believed they could earrv out the cognitive 
processing they perceived their teacher intended* 

The next phase of the proiect experimented with procedures 
that would modify students' perception of instruction and increase 
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their abilities to execute costive strategies we hypothesised 
would enhance the^r achievement, i\*o controlled experimental 
studies were conducted in wh* ch students participated in Lessons 
hv viewing videotapes of Mghly structured recitations. Although 
most students had worksheets available during these lessons that 
summarized the material to he 1 earned f only some of them had been 
trained previously to coordinate instructional cues delivered 
during the teaching with cognitive processing and written 
manipulations of information to he pasted. Thus, these studies 
explored the degree to which students* intra^lesson cognitive and 
overt responses to teaching could he directed hv signals given 
during teaching^ and whether these mediations of teacher behavior 
were related to achievement. 

Building on the methods and findings of the three preceding 
studies 9 a series of five concurrent parallel experiments were 
carried out in the th*rd phase of this proleet* These experiments 
involved careful observations of participating teachers' natural 
use of cues for students* cognitive responses, ^ased on these 
observations* a program was devised to train some students in each 
of the five elementary classrooms to respond to their own 
teacher's signal for carrying out an adaptable sequence of 
cognitive and written activities* There were three purposes for 
these studies. The first was to test whether procedures that 
characterised the earlier highly control led experiments could be 
adapted to the dynamic milieu of recitation lessons delivered 
under the conditions of everyday teaching In elementary 
classrooms. The second purpose of these studies was to explore 
for influences that students* aptitudes might have on their 
learning* Tn particular, we focused on contrasting students who 
used their naturally developed responses to Instruction with 
others who were trained to respond to teaching as their teacher 
intended. The third purpose of these studies was to investigate 
whether students who had been, trained to make certain pre-arranged 
cognitive and written responses to their teacher's signals learned 
more than their untrained peers using untampered-with learning 
strategies * 
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CHAPTER 2 



Students 1 and Teachers 1 Thoughts About 
Strategies for learning from Teaching 1 

INTRODUCTION 

One of the major objectives of this proiect was to describe 
aspects of the cognitive mediational paradigm under conditions 
that represented rather than distorted the behavioral and 
cognitive ecology of classrooms. Thus* the source of data for 
this study was teaching in schools as it was created by the 
teachers and students participating in that teaching, and these 
same participants 1 subsequent analyses of their involvement in 
that teaching* 

The general procedure followed to obtain these data was to 
videotape teachers 1 lessons* Following as close as possible upon 
a lesson, ususally within 10 minutes, the teacher was interviewed 
by a research assistant who had been trained to elicit the 
teacher's analysis of instructional events in terms of the 
cognitive mediational paradigm* To insure as much as possible 
that these analyses were reflecting actual events in the preceding 
l&sson* the primary stimuli for cuing the teacher's analyses of 
these events was the videotape of that lesson* 

A small group of students was interviewed as immediately as 
possible after the teacher interview about a representative sample 
of incidents that the teacher had analysed because he saw them as 
instruc tional ly important* Incidents were chosen to obtain some 
from each of the beginning* middle, and end of the lesson* Again, 
to anchor the students * analyses in the actual lesson that they 
had just experienced, the videotape served as the primary cue 
about what occurred during teaching* Audiotapes of these two 
interviews became the raw data For our analyses of the cognitive 
mediational paradigm as it was represented in the lessons sampled 
for this project* 

^ An article based on this Chapter appeared in the Elementary 
School Journal * (Winne 5 Marx, 1982). 
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. The purpose of this study was to explore the cognitive 
responses students tnaHe to teaching, and the cognitive processes 
their teachers intended them to use in typical classroom 
lessons* One ohleetive was to document how students and teachers 
saw cognitive processes as mediators between teaching events and 
1 earning, When such mediations were reported, our second 
objective was to identify whether students* cognitive activities 
were congruent with their teacher's intentions for how students 
should think. 

Documenting these mediati onal phenomena in their natural 
setting provides a possible link between theories of cognitive 
learning and theories of teaching. Tn this regard, a table of the 
relative Importance or frequency of all the cogni tive processes 
intended by teachers and engaged by students is less important 
than evidence that such events occur. Thus, frequency counts and 
distributions of occurrence of these phenomena are neither central 
to our purpose nor appropriate, As a consequence, this study 
departs substantially from typical classroom observation studies 
that have had as their goal the quantification of variables and 
the determination of statistical relationships among them. 
Moreover, because we cannot be certain that all possible 
categories of instructional events were represented in our sample 
of lessons, the data reported in this first study should not- be 
viewed as an exhaustive list of the cognitive mediational links 
between classroom teaching, and learning, At this point in • 
research about the cognitive mediational model, If we can 
demonstrate the occurrence of cogni ti ve^medl atl onal links between 
teaching events and learning, we believe that experimentation 
based on the paradigm is warranted. We 1 eave to future research 
the task of document i ng- a representative "state of nature" 
regarding students' cognitive processes during classroom learning, 
and the means by which teachers signal their intentions about 
these cognitive processes to students. However, in the studies to 
be reported later, we will take up questions about the actual 
effects of students' cognitive mediations of teaching on their 
achievement,, 
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METHOD 

P articipants 

Teachers . Three male and two female teachers from five 
different schools in two suburban school districts in the 
metropolitan area of Vancouver, British Columbia volunteered to 
participate in the study. Two taught grade seven classes, two 
taught grade five classes , and one taught a grade four class. 
Upper elementary grades were selected for two reasons. First, 
children at these grade levels generally have developed sufficient 
verbal and intellectual skills so that self-report procedures 
could be used productively. Second , at these grade levels, most 
curriculum areas are taught by the same teacher, thus providing a 
basis for genera lizabi I i ty across teachers, students, and 
curriculum topics. 

For reasons of confidentiality, fictitious names are used in 
this report for all the teachers. To further guarantee 
confidentiality, all references to the teachers will involve male 
pronouns (determined by a coin toss). 

The following descriptions of the teachers and their 
classrooms are intended to paint the rich context within which the 
da,ta to be described later were collected, 

Mr. Acton . Students in him class normally were seated in 
groups of four at tables organized in V-shaped rows. Some 
students had a clear view of the front of the room and the 
blackboard , while others had fro turn in their seat whenever that 
part of the room was used for^ instruction. Students had their own 
places, but they were free to move about the room as the lesson 
required. There were also . three or four areas around the side and 
back of, the room for small group activities such as art, reading, 
and music. - 

Only twelve students were involved for most lessons. At 
these times * a student teacher would take the rest of the class to 
anot f?r room for instruction* Two qf the lessons we videotaped 
involved the entire class after the student teacher had left the 
school. 



27 



40 



Being in the school Is like being in a beehive. There seems 
to be continuous activity, Teachers and children move about the 
building throughout the day producing a fairly high ambient noise 
level* As head teacher, Mr* Acton has some adnp n i s t ra t i ve 
responsibil 1 1 i es and was ac t ing pri nc i on 1 when the regul ar 
principal was absent. He is an outgoing person who is involved in 
many school activities. 

During instructional sessions* Mr* Acton maintained a relaxed 
atmosphere within fairly highly structured activities* Students 
were well aware of what was considered appropriate classroom 
behavior* Basic objectives and methods for lessons were planned 5 
but classes remained flexible so that, if they desired* students 
could explore topics in more depth* Mr, Acton demonstrated an 
awareness of the students 1 learning abilities and styles, and 
encouraged all students to participate in the ^lessons and help one 
another with learning tasks, / 

Mr. Anderson. Mr* Anderson has taught both elementary and 
high school. He is very involved .in school projects, and assumed 
some responsibilities for the principal* He also is involved with 
his students in several extracurricular activities such as sports 
and dancing. 

Only, a portion of tt{e class fpmrtici pa ted in a lesson while 

* . ■ /" > ' "u^ ■ /. ■ "* • 

the -others went to the. library with a student teacher* The 

\ , ' ^ 4 ' ' - 

stu^k^Cs 1 desks were, in rows facing the blackboard, and the class 

was decorated with "students ' wotk^firom various projects* 



Mr x . Adders. on planned his lessons In detail and referred to 



•A . 

arined his 1<__ 

his written plan frequently during ^teaching* His Masters degree 

,work_in using audiovisual equipment in instruction was apparent in 

\%b lessons. His lessons began as teacher centered in that he set 

the goals, determined the activities* and did most of the 
i 

talking, As the lesson progressed, he used questioning techniques 
to involve students in discussing the topic and to check their 
understanding. This sometimes evolved into student-centered 
activities, Mr* Anderson's lesson formats varied predictably 
^according to the subject being taught. For example* science 
involved students in experimenting, while health was a lecture^ 
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note taking format, He usually checked with students individually 
as they worked, giving them corrective feedback* 

The atmosphere of the class is characterised by a busy mood 
with students actively participating in lessons, Mr, Anderson is 
friendly and encouraging to students, often ]oking with them. He 
knew them well, and used his knowledge of their abilities and 
interests in determining who to call on during lessons. Students 
are expected to and do assume responsibility for their behavior so 
that the class is generally cooperative and well-diseipli tied , 

Mr. Lehmann , Mr* Lehmann is a personable, authoritative and 
outspoken individual who takes pride in his work and seems 
committed to maintaining a high standard of performance in his 
teaching skills and strategies, He had taught for many years at 
the high school level before making the transition into elementary 
school, where he now teaches a grade five class of eighteen 
students . 

The school operates a French immersion program in which 
students are educated the two official languages of Canada from 
kindergarten to grade seven, All of the students in Mr, Lehmann f s 
class, with the exception of one child who was a new immigrant, 
were fluent in both French and English, The classroom is in a 
"temporary" structure situated about 12 meters from the main 
building. There are windows facing the playground on one side of 
the* room and blackboards on the opposite side. The student desks 
are arranged in rows in the middle of the room facing the 
blackboards. The room is filled with student drawings posted on 
the walls and their poems hang from the ceiling. In one corner of 
f he room, videotaping equipment is set up for use by Mr, Lehmann 
and his students. 

Mr, Lehmann maintains a very structured and orderly 
classroom. The climate can be characterised as one of mutual 
respect, with both the teacher and the students enjoying their 
days together. He plans and prepares lessons ahead of time and 
adheres quite closely to an instructional process he acquired 
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while caking in-servf ce courses on instruccinnal Theory Into 
Practice. The sequence of activities used In all his lessons 
Included the following: sponge exercise, ant i ci pator y set , 
modeling, guided practice, monitoring, time framework, raising 
level of concern, active participation hy students, paraphrasing 
by students, accountability, and closure. 

During the first two weeks of school, Mr. Lehmann taught 
these procedures to his students and explained their purpose. As 
a consequence, the students are able to follow Mr, Lehmann' s 
instruction and understand his expectations regarding their 
behavior in the classroom. 

When teaching a lesson, Mr, Lehmann assumes responsibility 
for explaining, directing and goal -set t t ng . Halfway through the 
lesson, these responsibilities shift to the students who are held 
accountable for their learning and who are expected to participate 
actively in the lesson, giving and learning through paraphrasing. 

Mr, Orr, The 29 students in Mr, Orr's grade five class sat 
at individual desks placed around trhe perimeter of the room. Most 
students had a clear view of the blackboards situated at the sides 
of the room, The open center area of the room was used for most . 
of the formal instruction and for small group activities, A large 
room adjoining the classroom was also available for art and small 
group activities. Bulletin boards, walls, and doors were covered 
with the results of students* projects on a variety of topics, 
Twenty-five of the students participated in the research 
project* Most of the videotaped lessons involved the total 
class* For a few lessons, those not involved were given separate 

instruction in another room by a student teacher T 

Mr, Orr's lessons were planned to combine presentation of 
material, student clarification of new information, and 
application in a task carried out by individuals or groups* The 
teacher displayed a keen awareness of each student's learning 
abilities and needs, and an obvious enjoyment of teaching and his 
students, His special interest in art and audiovisual materials 
meant that lessons were colorful and that a variety of visual aids 
often were 'used* Although the lessons were quite structured, Mr* 
Orr showed flexibility in allowing students to explore concepts or 
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ideas in which they showed interest, even when this had not been 
planned as part of the lesson. 

During the lessons, he moved about uhe room encouraging 
individual students to participate, checking that those who 
normally had difficulty were grasping ideas, and giving a great 
deal of positive responses to all of the children. The students 
appeared happy and participated eagerly in learning activities. 

Mr. Richmond . Mr, Richmond is a high energy, verbal 
individual whose enthusiasm for teaching is apparent* Seeming to 
have barely enough hours in the day, he has an active professional 
life outside the classroom with various involvements in sports and 
teacher inservice. 

Tn the classroom he stresses the need to attract students 1 
attention, almost seeing himself as an entertainer as well as a 
teacher, He is very aware of student's feelings and abilities f 
and uses questioning and encouragement techniques frequently* 
While he is friendly to his students, he also is clearly a 
disciplinarian* He expects students to act responsibly, often 
leaving them to work unsupervised* They respond well to Mr* 
Richmond's trust* 

Mr* Richmond's planning for each lesson is detailed* Lessons 
follow a regular format of relatively teacher^cen tered recitation 
shading into lectures* These are followed by discussion or small 
group activities where Mr* Richmond makes himself available to 
answer questions and clarify assignments* He also uses this time 
to monitor the progress of individual students and provide 
personalized feedback to them. His interactive style is usually 
democratic, although he assumes total responsibility for deciding 
standards of class work and choosing curriculum content. 

Students * A total of 113 children participated in 149 
interviews over the course of the study. Informal consent was 
obtained from the parents or legal guardians of all participating 
children* These interviews were conducted by individual research 
assistants with groups of 2-6 students* Children were randomly 
selected by their teachers to participate in the interview 
sessions, and all participating children in each of Che five 



31 

; _ 44 



classes were Interviewed at least once, S1J! - - 

interviewed twice and five were interviewed three times during the 
ten weeks of data collection, Since we attempted to have at least 
three children in each interview, some children participated more 
than once due to small class siF.es in some w^, A tabulation of 
the number of students interviewed in the different classes and 
grade levels is shown in Table 1. 
S ources of Data 

Videotapes, Fifty classroom lessons were videotaped over the 
period of the study. Ten tapes were made of lessons by each 
participating teacher, The lesson content varied across 
mathematics, science, language arts, and social studies, The 
length of the lessons ranged from approximately 2 5-4 5 minutes,. 
One of the 50 videotapes was lost due to equipment failure. 

Audiotapes, Audiotapes were made of the teacher interviews 
and the student interviews. For the teacher interviews, 48 
recordings were made in total, One tape did not record because of 
machine failure; a second was lost, Far the student interviews, 
49 audiotapes were successfully completed, one was not recorded 
due to machine failure, 

interview materials . Logs were kept by the research 
assistant during the videotaping of each lesson. Part of a log 
entry was a meter reading on the videotape corresponding to 
teacher behaviors which the research assistant ludged as likely to 
invite lor otherwise involve students In cognitive responses at 
that point in the lesson. To identify these incidents, the 
research assistant had to be able to postulate a reasonable or 
possible mediating cogni tive process in which students might - 
engage in response to the instructional event, Preparation for 
this task was accomplished through simulations prior to the start 
of data collection, Along vi-th us, the research assistants 
watched videotapes of lessons used in our teacher education 
program. Together, we speculated about mediating cognitive 
processes that the teacher might be signalling, and discussed the 
reasonableness of these speculations. A brief behavioral 
description of the event and the research assistant's speculation 
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TABT.R 1 

D* sr, H hi in* on of RtudprtEs Tntervl eweH in Fnch Class 



Tea rhrr 



Numher of 

students 

* ntefvi eweH 



Niimher of stii^ 
dents 1 ntervl ewed 
more than once 



Acton 
Anderson 
Lehmann 
Orr 

R i rhmnnd 



4 
7 



i 2 
i 7 
11 



1 
ft 
1 2 

1 
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about che teacher's possible intentions for - ttd^nts' cognitive 
mediational processing completed each entry in the log. These 
events were candidates for analysis during the teacher interview. 

For the student interview 5 n structured format , reproduced in 
Figure l f was designed to standardize the questioning strategy 
used hv the research assistants, The student interview schedule 

constructed to probe in detail students' understanding of 
' 'u.ir cognitive mediational processing during instruction while 
accomodating their inexperience in describing these sorts of 
events. At each level the interview schedule was designed to 
elicit as much specificity as possible about the student's 
cognitive processing in the student's own words, When students 
were unable to do this, the interviewer suggested several 
mediating thought processes from which a student might choose to 
elaborate (for example, see Level II f Figure 1), 

Following an introduction, the schedule began at Level ! by 
soliciting students 1 perceptions about relatively global cognitive 
states and behavioral events in the lesson* As the interview 
proceeded to Level II, the research assistant framed questions 
that probed more deeply students 1 perceptions of the cognitive 
processes possibly supporting their participation in 
instruction. Following this level, the questions sought 
information about qualitative features of the instructional events 
surrounding their cognitive mediational processing fLevel lit), 
and students' comprehension of hdw their cognitive mediational 
processing might relate to acquiring and retaining the content of 
the Wesson (Level IV), Finally, the students were asked to 
describe alternatives to the instructional event and its 
corresponding cognitive mediational processes (Level V)i and to 
express their view about how .the instructional event was 
integrated within the flow of the lesson. At each level f 
contingencies were incorporated in the schedule to permit its 
4 adaption to individual students 1 responses, and to promote as much 
specificity as possible in students 1 responses prior to the 
research assistant's providing an external structure for their 



LEVEL 11 
Process 



LEVEL ILL 
Clarity 



I j i t3 you under stand the material up Ee here? 

i ! 

No ; 



Can you tell me what you were having 
^rouble understanding? 



you know why you were having truuble 
understanding ? 



Did you understand why the teaeher was 



Yes i 
"hy did lie/she da that? 



No J 

Do you think the teacher wanted you to be 
, thinking In some (other) special way that 
would help you to understand (learn)? 



What wag that way 
of chinking? 

i 

Do you suppose that the teacher wanted you 

£9 by _ ? 



s cycle through Levels III 
£ IV for - each positive 
response 



(paying attentions recognizing, grouping, 
— relating, rememberingr inventing, -fflaklnl trp^ 
guessing, asking, repeating, using a 
special way to learn) 



Was It cle:ir tu yuu that you were supposed to be thinking that way? 



What niady it su c ly ar ? 



No 



1 



Hgw might the teacher have made it clearer 
that you were supposed to be thinking 



LEVEL IV 
Relation of 
process to learning 



Do you think that _ 
How J On s it help you? 

■ I 

How de yuu learn hy doing 



helps you learn (understand, remember)? 



No 

Why not? 



Is there a better way for you to Iparn the material? 



(ask a question* repeat the material to yourself, 
draw a picture, raake up a little story, 



Did you knnw wha t would happen nest? 

^ llnw did y nit knnw that? What told you? 

NUItbi By sensitive to wise the r the current question has been answered already in the 
§tudeut*s answers to pryvtous questions, If so, skip the question. 



Figure 1. Student Interview Schedule 



comments, e*g* ? by providing alternatives from which they might 
choose or elaborate on. 

The research assistants were trained to use this schedule in 
simulations prior to gathering data in the schools. These trials 
also produced several modifications to pilot versions of the Final 
schedule that is displayed in Figure I. 
Procedures 

Videotaping . Each teacher was assigned one research 
assistant for the duration of the study* After initial contact 
had been, made with the volunteer teachers by the principal 
investigators, all subsequent scheduling for videotaping and 
interviewing was done jointly by the teacher and the research 
assistant* The research assistant was responsible for collecting 
a 11 da ta - and—for - ac ting _as_ a 1 i a i son be tween_ the :_ Jteacher _ and the 
project, A backup person was available in case one of the 
research assistants could not attend a taping session. ThTs 
person, who s also functioned as the administrative coordinator of 
the project, attended all training and other project meetings to 
insure comparability with the other research assistants. In only 
one instance was the backup person required to collect data. 

Data collection began in the third week of February and was 
completed by mid-April for three teachers, and by early May for 
the other two, as shown in Figure 2. This variability was due to 
cancellation of sessions on the part of teachers as a result of 
conflicting school activities (e.g. , field trips). 

The procedure for data collection in the classroom was the 
same for all teachers, At the scheduled time, the research 
assistant went to the school with the videotape equipment and set 
it up either before class began in the morning or during recess. 
An information sheet provided procedural notes for setting up the 
vide© and audi© equipment, and a checklist for its operation. 
Then she videotaped the lesson and took brief notes about 
instructional events that might be analyzed during the teacher 
interview, as described earlier. After the lesson, the research 
assistant took approximate ly ten minutes to move the playback 
equipment to another room and prepare for the teacher and student 
interviews. 
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FeHrarv March April Mav 

141 ? 1 4 1 ?14 1 2 

Acton 1 ______ ; — | 

Anderson | ■ — — — — _ _ _ _ — — | 

Lehman | _ — . — i 

Orr 1 : 1 

Richmond |— — . ^ ^ j 

Figure 2 _ Length of involvement of each teacher s Study T 



Microfilmed From 
boat Available Copy 
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Teacher interview . The teacher viewed the videotape of the 
entire lesson* He was asked to stop the videotape at points where 
he intended the students to make particular cognitive responses to 
his teaching* They were prepared for this task prior to 
videotaping by a discussion of about a half hour in which we 
described examples of what we later define as instructional 
stimuli and i tended cognitive responses fsee Results section^. 
One example we used in these discussions was n higher order 
question, where the teacher's choice of a particular syntactic 
construction is intended to signal students to engage in a 
complicated mental process such as analysis or synthesis* The 
research assistant also stopped the videotape at points she had 
noted in the log if the teacher passed over a large number or 
variety of salient incidents. It was made explicitly clear to the 
teacher that he should not invent an analysis of his intentions 
for students 1 cognitive mediational responses when he intended 



During the interview, the audiotape recorder was turned off 
while'the videotape was being viewed* Then, as either the teacher 
or research assistant stopped the videotape to analyze an 
instructional event, the audiotape recorder was turned on* Each 
time this occurred the videotape meter reading was announced by 
the research assistant or the teacher so that the audiotaped 
discussion later could be keyed to its respective segment on the 
videotape. These numbers* and brief notes that identified the 
intention being discussed* also were recorded on teacher interview 
log sheets so that the general features of an analysis could be 
examined without the use of playback equipment* 

The surface features of the interchange between a teacher and 
the research assistant varied somewhat from the analysis of one 
incident to the next. In all cases, however, the goal of the 
analysis was to obtain from the teacher as precise a description 
as possible about the cognitive processes in which he intended 
students to be engaging in response to his teaching. Sometimes, 
the teacher reached this objective without prompting or requests 
for clarification by the research assistant* However, when 
probing was necessary, the research assistant followed the format 
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of Che structured interview for students (see below). Most 
snnlvses took s form in h@ ^w?^^ tt^^se two extremes of invol vsn^nt 
of the research assistant* 

The research assistant was careful to probe the teacher's 
descriptions in ways that solicited analyses from the teacher 
rather than asking him to verify whether one or another 
speculation offered by the research assistant was accurate. Only 
after probing of this sort proved insufficient for clearly 
describing aspects of cognitive processing the teacher intended 
students to use did the research assistant request clarification 
in ways that directly structured the teacher's description of his 
intentions for students 1 cognitive processing* This procedure was 
used to reduce the chances that the researchers 1 biases would 
influence the teachers' self^reports * However, we have no data 
that support the validity of this procedure, nor any reliability 
data which indicate that research assistants selected the same 
types of incidents for teachers to comment upon, 

The teacher interviews ranged in length from 23^50 minutes. 
At the end of each interview the teacher was asked to identify 
several instances from the log about which he recommended the 
students be interviewed. In some cases (about 15% of the 
lessons), the teacher was unable to identify certain instances as 
being more appropriate than others, In these cases the research 
assistant selected incidents which she judged the teacher had 
stressed during the interview under the constraint that there be 
at least one selection from each of the beginning, middle* and 
conclusion of the lesson, Some of these selections may have been 
those selected by the research, assistant for analysis* 

Student interview , The research assistant spent 
approximately 10 minutes after the teacher interview preparing 
materials and planning for the student interview* Usually, three 
to four students were interviewed at a time, although occasionally 
slightly larger or smaller groups of students were involved in the 
interview due to factors not under the research assistant's 
control, such at school activities scheduled^following the 
interview period* Both in the student interview log and on the 
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audiotape recordings* students 1 first names were identified. 
Also* the number of previous interviews each student had been 
involved in was logged. Whenever students were interviewed for 
the first time, they were informed of the purpose and procedures 
of the interview. 

The research assistants were given a written statement which 
they paraphrased to introduce students to the interview 
procedures* It consisted of mutual introductions in the group and 
a brief description of what would be occurring during the 
interview, i.e., viewing the videotape and answering questions 
about how they were thinking during the lesson. Students then 
were shown preselected videotape segments , beginning a minute or 
more ahead of the actual event to\be analyzed and usually going 
several seconds beyond the event so that they could re-experience 
the context = in which the event occurred. - Ana ly sirj^r each 
incident was completed before the next videotape segment was 
shown , 

During the first week of data collection, questions were 
directed to the students as a group, We discovered that further 
probing could not be done in a systematic fashion under these 
conditions. Thus, this procedure was altered for the remaining 
nine weeks. For the first event to be analyzed/ one student was 
chosen randomly, This student responded to the entire set of 
interview questions about that instructional event before 
interviewing other students about that incident * However, to 
insure that other students* analyses: of this event were not 
forgotten or lost, the others in the group were invited by the * 
research assistant to add thoughts of their own after the set of 
questions comprising a major level irt the interview schedule, 
(e,g,, level II f process; see Figure ll ) had been completed with 
the primary student: Thus* one targejt student's complete analysis 
of the instructional event was supplemented at each 'maTor level of 
the interview schedule with comments from other students in the 
group when they had different answers re^ the interview 
questions, This procedure allowed a ful iXr^nge of student 
responses to be obtained with the greatest possible efficiency. 

S3 



When analysis of the first incident was complete, the research 
assistant randomly chose one of the remaining students and began 
the interview afresh following the viewing of the second 
incident* Whenever possible within time constraints for keeping 
the students out of class , each student in the group served as a 
target student for a unique instructional event. In those few 
interviews where relatively few instructional events were selected 
for analysis due to the nature , of the lesson itself, or where a 
student was unable to answer any of the interview questions , more 
than one student was interviewed about a single instructional 
incident using the full interview schedule, 

As with the teacher interviews, the playback of videotape 
segments was not recorded on the audiotapes, but references to 
videotape recorder meter numbers were announced as the" analysis of 
each new segment was about to be recorded on the audiotape. Notes 
were written in the student interview log regarding any - 
circumstantial conditions that were seen as unusual or of 
potential importance* ^ 

Transcription of interviews^ To bavff data that could be 
easilymanipulated during analysis, the audiotaped interviews were 
trancribed into written form* Perforated cards were selected for 
this purpose because they could be maintained in their original 
sequence or separated and rearranged, as the analysis proceeded. 
Teacher interviews were typed on white cards and student 
interviews on buff cards for easy identification. . 

To assure accurate, verbatim transcriptions of the 
interviews, research assistants dictated original interviews onto 
new audiotapes using standard instructions for resolving garbled 
or faint passages, for reproducing the interviews in a consistent 
format, and for inserting punctuation and identifying changes in 
speaker . 
Data Analysis " 

Analysis of data represented by , the videotaped lessons and 
transcriptions of teachers* and students 1 stimulated recall 
interviews about these lessons progressed through three stages. 
First, the research assistants* field notes and the transcripts of 
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teacher and student interviews were examined while we watched the 
videotape of each lesson* In addition to getting an overall 



Interpretations about the behavioral interactions the teacher and 
students displayed in the lessons and commented on in the 
interviews. We also studied the teachers' descriptions of the 
cognitive TmBporimh& they intended their students to make alongside 
the cognitive activities students described in their analyses. 
The goal at this stage of the analysis was to he as inclusive as 
possible in representing the behavioral and cognitive features of 
the instructional milieu as these were represented on the 
videotape and retrospectively described by teachers and their 
students. Any reference by a teacher to intended cognitive 
responses for students, or by students to a- thought process they 
used in response to some aspect of the lesson was noted in this 
first stage of the analysis. 



With these notes , the videotape of each lesson was viewed 
again and analyzed to identify parallels and similarities among 
the instructional episodes s and the teachers 1 and students' 
descriptions of these episodes* The intent for th*s stage of the 
analysis was to produce a descriptive system for classifying 
instructional events in terms of behavioral interactions and the 
cognitive processing described by participants relative to that 
interaction* To allow comparisons of one instructional event with 
another ? several alternative psychological terms were used to 
represent the cognitive responses that teachers and their students 
were describing. 

The final stage of analysis involved classifying the products 
of stage two* Various schemes were considered with respect to: 

(1 ) their ability to capture the richness of the original lessons 
and reflect the descriptions provided by teachers and students^ 

(2) the relative distinctiveness of categories w* thin the system; 

(3) the linkage between the category labels and existing 
psychological theories; and (4) the ability to recreate the 
category system when f ndex cards on which the descriptions were 
written were shuffled and resorted. 



impression of the lesson, we made notes and preliminary 
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RESULTS 

On each occasion where etcher a teacher or student remarked 
that a particular cognitive process was involved In learning from 
teaching, we assumed that something in the teaching environment 
signaled that the process was to be used, We labelled these 
signals instructional stimuli (IS)* Each instructional stimulus 
was associated with at least one, and sometimes several, cognitive 
responses that a teacher or a student described in an interview, 
Conversely, teachers and students often associated several 
different instructional stimuli with one kind of cognitive 
response. 

When teachers identified an instructional stimulus during 
their interviews, they were asked to describe how they expected 
students to respond cognitive! y to this cue* In other words, we 
asked teachers to describe how they tried to manage students' 
cognitive processing at key points in lessons by their deliberate 
use of instructional stimuli , For these occasions where teachers 
described instructional stimuli, we also asked the students 
whether the teacher wanted them to be thinking in a special way 
(see Figure 1, Level II)*' Thus, we collected studints' 
interpretations of the cognitive processes they associated with 
the instructional stimuli their teacher had identified* From both 
points of view, then, a cognitive response associated with an 
instructional stimulus was one the teacher intended students to 
use, either as the teacher described the intention or as students 
perceived the teacher T s intention* Therefore, we called cognitive 
responses to instructional stimuli intended cognitive^ responses 
(ICR), The pairing of an instructional stimulus with an intended 
cognitive response constituted what we label an instructional unit 
or an TS-ICR unit* 

The cognitive mediational paradigm is based on a premise that 
students* cognitive processing mediates the effects that teaching 
has on students' learning. In our terminology, intended cognitive 
responses act as a filter, an amplifier, or a bridge between the 
instructional stimuli teachers use while they teach and students' 
memorial representations of the curriculum they construct during 
teaching. To reflect the central position of these psychological 




events, we organized the interview data according to intended 
cognitive responses as they were described by students and by 
t eachers . 

Three raalor categories of Intended cognitive responses to 
instructional stimuli were identified, each of which had one or 
two further levels of specification. The first category was 
orienting which referred to directing or redirecting students* 
cognitive processing to content or activities in a lesson. The 
second category was operating which entailed cognitive 
manipulations of information that were precursors to learning per 
se. The third category, consolidating, described intended 
cognitive responses that would enhance storage and retrieval of 
information or feelings. The full classification system 
describing intended cognitive responses that we developed is 
presented in Table 2, 

Host intended cognitive responses had three features. One 
feature related to the type of goal toward which students were 
working or to a cognitive product that was to be achieved as a 
result of cognitive processing. Two illustrative types of goals 
ar^e feelings and problem solving strategies. An example of a 
cognitive product would be an appraisal of one's work such as "T 
did very well at x, M A second feature concerned the sl^e of the^ 
goal or the amount of information to be processed* Some intended 
cognitive responses pertained to relative] v simple instructional 
goals or a single item of information* Others required maior 
shifts in memorial representations of content or the affective 
climate of the classroom, or large quantities of information to b 
manipulated. The third feature pertained to the immediacy of the 
intended cognitive response. Sometimes, students* cognitive 
processing was to occur at the same time as the instructional 
stimulus was used. Other instructional stimuli informed students 
about cognitive processing they were to use throughout a lesson. 
Yet another version of immediacy occurred when an instructional 
stimulus that cued cognitions appeared early in the lesson, hut 
the cognitive processing itself was to take place later. 



44 



57 



TABLE 2 

Intended Copi t^ve Responses in Classroom Teaching 



T. Ofi entin^i Controlling the goa^s toward which students work. 



A. Affective States: 

to promote engagement with lesson activities because 
these activities are eniovahle, they satisfy curiosity, 
or thev Increase arousal, 

to elicit positive affective states as a side effect 
of engaging In an activity, 

' , Arousal : 

— to Increase or decrease anxiety* or other affective 
states . 

B. Identifying Content: 

to orient toward specific content to hfe learned* 

l . Macroscopi c./*f oeus: 

to create or to elicit a cognitive structure within 
which more specific lesson content could later be 
lodged. 

2, Microscopic focus: t ^ 

to attend to a specific item fas opposed to larger 
units of content ) to be used either immediatel y or at 
a later point in the lesson, 

3- Multiple ml eroscopl c Items: 

to attend to several . sped f 1 c Items, as 1 n 
microscopic focus, 

C. Cueing Procedures: 

- to cue procedures to follow in developing and acquiring 
content presented in the lesson, The teacher's intention 
has to he 1 1 teral l y identified In the Instructional 
stlmul us . 

1, Behavioral interactions: 

— to direct to an overt, behavioral interaction for 
controlling cognitive activity. 



External materials: 

— to refer the student to material external to the 
student f s memory that would facilitate cognitive 
processl ng. 

Acquiring content: 

— to orient to cognitive processes applied in working 
memorv. 



4, Ftofing content f n nemorv: 

— to prepare to transfer the contents of working memory 
to long-term storage, 

TT • Operating: the way students think during instruction to achieve 
the intended products, such as recognition and comprehension, _ 

A . Com pari ng: 

- to compare items of content to support acquisition o f 
that content, 

1, Unspecified comparing: 

— to engage in a general com par r procedure that would 
distinguish a cued item from other items of content; 
similar to microscopic orienting, 

2, Comparing codes: 

— to facilitate students* acquisition and comprehension 
of content by having them compare the meanings 'that 
accompany different wavs of coding that content . 

3, Comparing attributes: 

— to compare attributes of two or more concepts, 

4, Using rul est 

— to apply rules developed in the lesson to new 
instances; to compare the steps in a rule with 
aspects of a particular instance to which the rule 
was applied, 

B. Generating: 

- to generate a new code for representing content; to 
generate new content using procedures or information 
provided in the lesson, 

1 . Generating codes: 

™ to create alternate representations ^or information^ 

2. Generating rul est 

to create a schema that provides a structure for 
generating a product, 

C, Using Metacogni ti on: 

- to think about cognitive processing and the results of 
that processing, 

1 , Monitoring: 

.. — to examine the cognitive procedures used to produce 
answers to questions or hypotheses, 

2. Appraising: 

— to evaluate the state of knowl edge and monitor the 
emotional response to that status, 

TTT. Consol i dating i practice designed to promote storage and 
r e t ri evabil i t y of content. Students are expected to have 
already achieved comprehension of content prior to attempting 
consolidation, 
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Qrj en t i ng 

Almost all contemporary theories of cognition postulate that 
learners have goals toward which they direct their cognitive 
processing of information* This feature of the cognitive lives of 
students" is clear ly recognized by classroom teachers. Indeed, it 
is commonly accepted that one of the teacher's major objectives is 
to control the goals toward which students are working in 
lessons* When teachers used instructional stimuli to try to 
control the goals toward which students worked, or when students 
interpreted an instructional event as, cuing them about goals, we 
categorized the intended cognitive responses they described as 
orienting* 
Affective States 

Two kinds of affective goals were seen to be end products of 
orienting* One goal was engagement* When this goal was 
approached, teachers and students described orienting to new ^/ 
lesson activities that would be enjoyable or that would satisfy 
curiosity* The other goal of orienting was an increase in 
students* level of arousal* presumably to some optimal level for 
learning* The cognitive product associated with both these goals 
was motivation to be actively involved in learning* 

Engagement * Instruc tional stimuli* intended to orient 
students toward activities were generally indirect or implicit* 
Often* teachers intended enjoyment to be a side effect of 
students' engagement in learning rather than being a result of 
what they would learn* Frequently, teachers had students give 
examples from personal experience to set the stage for engaging in 
subsequent tasks* At these times* teachers referred to activities 
that were "fun" as leading to engagement* For the most part, 
students did not notice instructional stimuli intended to orient 
them toward engaging in activities that would produce enjoyment. 
Most children said they focused only on the task posed by the 
teacher* Very few understood that the activity per se was 
designed to make them "eniov" the lesson* For example, Richmond 
demonstrated his own enjoyment in a lesson by raising his hand in 
an animated manner to answer a question he had just posed. He 
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intended students to orient toward becoming personallv involved in 
the lesson and thereby enjoying their participation in it* One 
student oriented to content instead of affect. He thought the 
teacher was going to answer the question, A second student 
oriented to procedures. He thought this was a signal for him to 
put up his own hand. Neither student viewed this instructional 
stimulus as a cue to orient to something affective about the 
lesson* 

In at least one case, an instructional stimulus intended to 
orient students to enjoyment through engagement actually produced 
anxiety, Richmond started one lesson by stating a performance 
objective that would involve students in applying a rule to a 
real^life problem at the end of the lesson*- One student responded 
as Richmond had intended by predicting this task would be easier 
because he could see how the lesson content related to his 
personal life* He was motivated to engage in learning content 
that would be presented later in the lesson. 

Researcher: Why do you think Mr* Richmond would want you to 
know what you were going to end up doing? 
Student: Well* it's easier to learn when you know what 
you're going to make — — sort of like making a model; so you 
just put the pieces together if you know what you're going to 
make first. 

A second student reacted very differently* Because 
Richmond's objective appeared complicated, he panicked, 

Researeheri Was there anything, Mike, that was different for 
you? 

Mike: Yeah, he does it all th=e time, and T really don't like 
it because it kind of scares you at the start when he goes, 
"This is what you're gonna do, you're gonna learn how to 
measure a tree and how you do it outside," and T get scared 
because T don't think I'm gonna be able to do that .,* Sp, 
you know* if you're gonna go outside and measure it,^ it 
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sounds so complicated to me, and I'm scared, and T just 
quiver a lot, because he — well what happens if T won* t be 
able to do that? So T kind of w* sh he doesn't do that right 
at the very start. You know, it's just kind of hard to do, 
because it does scare vou a lot. 

Researcher* T see, so it has a different effect on you, 
especially if what he says you're going to be able to do 
seems to you to be something you might not be able to do, and 
you think you f d be more relaxed and learn better if you 
didn' t know, 

Mike: Yeah and then he'd say, "How about you guys go out and 
measure a tree," and I say, "Oh, O.K., it f s a challenge** — 
but If he says it at the start, and then I don't pay 
attention, I'm trying to catch everything he says and I get 
confused * 

In general, when these teachers used instructional stimuli to 
promote orienting to an activity that was intended to create 
positive affect as a cognitive product, the stimuli did not 
function as intended- This seems to reflect students* 
misunderstanding of the immediacy and the goal of these intended 
cognitive responses* Instead of looking forward to an activity 
with enjoyment, students usually focused on the content in the 
task or the task as a procedure* Rarely did students anticipate 
positive affect that might result from engaging in the task. 

Arousal , Orienting students to engage in a Wesson by 
increasing their arousal was cued most frequently by a teacher's 
use of the word "test." This was intended to orient students* 
attention immediately to lesson content or to procedures , and this 
effect was intended to endure throughout the lesson. Students* 
orienting was consistently cued when teachers gave this classic 
signal, and they almost always said this resulted in increased 
arousal* However, their understanding of how to go about learning 
material for a test was not enhanced by arousing them. On only 
one occasion did the instructional stimulus also help a student 
identify content? he said he should orient to "hard words" in 
upcoming parts of the lesson. 

49 62 



Neither teachers nor students reported that orienting to 
achieve arousal was likely to produce an effect that lasted beyond 



the immediate lesson. However, this cognitive mediae! onal link 
was a strong one. Teachers and students were well aware of 
instructional stimuli that were intended to orient students to 
engagement by Increasing arousal . Often, teachers did not Intend 
students to make these links consciously. Tn some ways, the 
instructional stimuli were to evoke arousal like a classically 
conditioned response* By this, we mean that the teacher's 
instruction serves as a conditioned stimulus intended to evoke a 
relatively unconscious response from students regarding their 
current affective state* We speculate that teachers may he 
unintentionally establishing long-range affective traits in 
students as a by-product of their relatively immediate intentions 
for orienting instructional stimuli regarding students* 
motivation, That these rarely were mentioned can he construed as 
evidence that these considerations almost are taken for granted, 
like an involuntary response that follows the presentation of a 
conditioned stimulus* Here is one example Richmond provided when 
he was talking about his introduction to a science lesson* 

Researchers ,So you wanted them to just pay attention? 
Richmond* I'm hoping that they tie th<s activity, this 
really happy* positive fun type activity in with anatomy, so 
that when they think M anatomy," they think that it was fun, 
They don't specifically know what happened, 1 guess , about it 
that was fun* All they know is we did something that was 
really a lot of fun* 

Identifying Content 

^ a i ~ T 

Intended cognitive responses where students oriented to 
content in the lesson were grouped in _hree categories that 
varied according to the amount of the information* These three 
groups were macroscopic content, microscopic content, and multiple 
microscopic items* Orienting to content usually was viewed as a 
first steTp for other cognitive processes like compare or generate 
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that are discussed later, Orienting to focus on macroscopic 
content almost always was intended to endure throughout the 
lesson. In contrast, both kinds of microscopic focusing were 
intended to have immediate and short-lived effects on cognitive 
processing. 

Macroscopic focus, The purpose of orienting students toward 
macroscopic content was to create a cognitive framework that they 
could use to organize more specific content that would be 
presented later in the lesson. The instructional stimuli that 
cued macroscopic focusing occurred at the beginning or very early 
in lessons* In some instances, the framework to he created was 
not directly related to the topic of instruction, as was often the 
case for Lehmann in his use of "anticipatory set." In his case, 
anticipatory set frequently was followed by a brief activity, 
e.g., having small groups of students (2-3) discuss with one 
another the defining characteristics of a topic introduced within 
the context of the anticipatory set he had provided. For 
instances Lehmann began one lesson by describing a parking lot 
with its many parallel lines into which cars fit neatly. He 
intended this instructional stimulus would orient students to a 
rule to write neatly with each letter occupying a uniform space in 
a word, like cars parked between lines in a parking lot. 
Occasionally, these instructional stimuli resembled advance 
organizers (see Ausubel, Hanesian, & Novak, 1978)* For instance, 
Richmond sometimes opened lessons with a question. This 
instructional stimulus was intended to orient students to 
information in the lesson, to help them encode It, and sometimes 
even retrieve it. 

Students usually failed to interpret with accuracy 
Instructional stimuli that cued orienting to macroscopic 
content. For example Acton started a language arts lesson by 
reading a paragraph, intending students to infer characteristics 
of stories that required inference making. However, all three 
students we interviewed perceived they were to jarialyze the content 
In the introductory story. Instead of orienting to global aspects 
of stories, thereby producing a framework for content to be 
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Introduced subsequently, the students oriented to microscopic 
Items in the story Acton had read. 

In another case, Anderson intended macroscopic orienting to 
be students* response when he asked them to give illustrations of 



answers on the blackboard * He i nt ended thfs to gui de st udents in 
generating a cognitive structure for content to he Introduced 
later in the lesson, The student interviewed was not aware of 
Anderson's intention for this instructional stimulus. Instead^ he 
tried to memorize the microscopic items written on the hoard 
rather than creating a macroscopic framework* 

When the purpose of an instructional stimulus was to orient 
students to macroscopic content s they usually tried instead to 
learn the microscopic content being presented at that time instead 
of creating a larger structure for later material* Tn other 
words, students often focused on the immediacy of the cognitive 
response* mistakenly thinking it should be applied to the content 
being presented instead of creating a framework for information 
that would emerge later and treating this cognitive product as an 
enduring guide to subsequent cognitive processing* 

Microscopic focus. Instructional stimuli that cued students 
to orient to small hits of information required either an 
immediate cognitive response or one that endured throughout the 
lesson* When Acton T s students were listing examples of a concept 
while he was writing them on the board, he abruptly asked the 
students for attributes of the concept* He intended to orient 
them to these microscopic pieces of information so they could use 
them to retrieve more examples* f All three students interviewed 
found this confusing. They were busy wondering why the teacher 
changed topics so quickly instead of orienting as Acton had 
intended * 

Quest! on^and^answer exchanges ware typical settings for 
microscopic orienting that was intended to last throughout a 
lesson, For example, Lehmann asked students early in a lesson to 
describe the concept of prime numbers* He wanted them to orient 
to these attributes because they would be used later with 



a particular concept and then selectively recorded some of their 




fractions* *One student failed to orient because he could not 
remember what a prime number was* Undaunted, he listened to 
another student's answer, believing it would be important for 
something later in the lesson. Another student described his 
cognitive response to tMs question as finding the definition of a 
prime number in his memory, Figuring out what distinguished prime 
numbers from other kinds of numbers, and "locking it in your 
mind* 11 He said he did this because he predicted this information 
would be needed later, Thus, by different means, both students 
achieved an appropriate cognitive product, 

A second instance of microscopic focusing in question^and— 
answer exchanges occurred in Orr's class. He was rephrasing 
students 1 reasons for placing examples in one or another category, 
intending that students would orient to the specific criteria for 
performing this task. Both students we interviewed said this was 
exactly what they did. Moreover, one student said that Orr's 
rephrasings provided a model for his answers that he could use 
later in the lesson* This is evidence for an enduring effect at 
both microscopic and macroscopic levels. 

Unlike orienting to macroscopic content, instructional 
stimuli that cued orienting toward microscopic content, either for 
immediate or for later use, were relatively well understood by 
students* Perhaps this contrast relates to observations that 
instructional stimuli that cued macroscopic content identification 
were introduced early in the lesson, before content had been 
developed. In contrast, some content and a context had usually 
evolved in the lesson by the time Instructional stimuli cued 
microscopic content identification. This may have provided needed 
additional information that helped students perceive this intended 
cognitive response. 

Mu I t ipj^ e mi c ro sc <3 p i c it emS i Some intended cognitive ^ 
responses required students to identify more than one microscopic 
item of information and then operate simultaneously with these 
multiple items. Although this often entailed procedural cuing 
that we describe later, several incidents are included here 
because they emphasized microscopic content identification. This 
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overlapping among eateogires illustrate?? the difficulty of 
separating some classes of intended cognitive responses, 

The instructional stimuli that cued orienting to multiple 
microscopic items sometimes were the simplest we observed . For 
exampie P both Orr and Acton used obvious cues on the chalkboard 
(e,g,, underlining or using colored chalk), intending students to 
identify a concept and its attributes, and to compare this concept 
with some other concept. Students consistently attended to these 
cues* but they had less success matching their cognitive responses 
to the teachers' intentions* In a lesson on fractions in which 
Orr used colored chalk to focus students 1 cognitive processing on 
multiple i terns , one student indicated chat he focused on a single 
marked item without referring to any of the others that Orr wanted 
him to compare to the identified one, Two other, students 
interviewed also noticed Orr's cues, hut didn f t know how to think 
differently about the concepts they referred to* 

In Acton's class, underlining a word on the chalkboard to 
indicate it as an instance of a concept was intended to cue 
microscopic content identification that would he followed by 
comparing* The student interviewed about .this incident responded 
perfectly* She noticed the visual cue, oriented to the particular 
attributes of this concept, and then proceeded to extend cognitive 
processing to analyze why one item was underlined and other items 
were not * 

What may characterize these events as a group is that 
students often could not associate a specific cognitive response 
with the instructional stimulus because this pairing either had 
not been practiced enough or was too inconsistent* Our 
speculation about this is based on an occasion in which an 
overiearned response was cued by a visual stimulus* ^pec i fical ly, 
Acton was using well-learned symbols to indicate how students 
should pronounce words in a language arts lesson. The ^ttfdent 
interviewed about this incident indicated he knew the meaning of 
these visual cues and also said he understood that these cues 
referred to specific concepts that would he involved in a 
subsequent cognitive task. Thus , * ins true 1 1 ona 1 stimuli that cue 



microscopic content identification followed by subsequent 
cognitive processing may not be well understood by students unless 
both the concepts being identified and the subsequent cognitive 
processing implied by the various instructional stimuli are clear 
or wel 1 -prac ti ced responses, 
Cuing Pro c e d u res 

There were four procedures toward which students were 
oriented by instructional stimuli I behavioral interaction, use of 
external materials, use of a cognitive process to develop content 
(what we develop latei as several types of cognitive operations on 
content), and storing material in memory (which we treat 
subsequently as consolidating). The data we classified as 
procedural cueing are somewhat difficult to distinguish from 
orienting toward microscopic content followed by another cognitive 
< process (like comparing), and from fairly direct injunctions from 
the teacher for students to engage in cognitive processes such as 
comparing. This also reflects the overlapping and correlated 
nature of these phenomena in their natural environment. The rule 
we used to place incidents in the category of procedural cuing was 
whether the teacher's intention was literally identified, in the 
instructional stimulus. If this intention was implicit, the 
incident was categorized as cuing procedures* If the intention 
was explicit, the event was placed in the domain'of cognitive 
operations, described later, 

Behavioral interactions * This category is unique in that an 
overt, behavioral interaction was used to promote cognitive 
activity* For example, a student who had just given a wrong 
answer was told to listen to a second student's answer, This was 
an instructional stimulus by which the teacher Intended to orient 
the first student to be ready to paraphrse the second's correct 
answer. A second incident, also in Lehraann 1 s class , was one, in 
'which he had students engage in a small grodp discussion, the 
topic of which was the nature of small group discussion skills, 
The intention was that this activity would orient students to more 
efficient ways for developing lesson content in small groups, A 
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student interviewed on this point reflected this intention 
precisely, A third incident in this subcategory occurred In 
Anderson's class when he said* "T'm going to check with vou to 
make sure you've learned what I've said," He Intended to orient 
students to a procedure that would be followed throughout the 
lesson. This enduring intended response was confirmed precisely 
by one student we interviewed, and more vaguely though still 
accurately by a second. 

These instructional stimuli were clearly understood by the 
students, Tn fact, students had a well-developed understanding of 
general behavioral interaction patterns in their classrooms. For 
example, when askad how they knew what the teacher would dc next, 
students frequently replied, "Because he always does it that 
way/* Incerdei? cognitive responses were interpreted accurately by 
^Cu£?.?nts when the link between an instructional stimulus and the 
intended cognitive response had been practiced frequently. 

External mater 1 ai s . Teachers often used instructional 
stimuli io orient students to places, usually the chalkboard or 
the students' notebooks, where content or operations for 
manipulating content were presented, Teachers reasoned this would 
ease the burden of cognitive processing for students. They wanted 
students to use this information either later in the lesson or in 
reviewing lesson content for a subsequent purpose, such as a test 
or a laboratory exercise. 

One example ocurred when Richmond dictated information for 
students to record in their notebooks. He intended students to 
refer back to their notes later while learning other material. He 
said that students should find this activity useful in helping 
them transfer this material to new tasks, A student we 
interviewed saw a clear advantage to taking notes, particularly 
when the teacher told him what to put In his notebook. This 
strategy is efficient, he said, since he would not have to 
remember all of the content but only the part of 1t not included 
in his notes, However, the student made no reference to the 
teacher's intention to enhance transfer by this procedure. 
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A HnronH example was f 1 lustrated by Anderson's review 
question/ "What *s Che important thing you have learned?'* He 
intended students to orient to Information on the chalkboard. One 
student's view of the intended cognitive response was like 
Anderson's: she made explicit use of the external material in 
order to answer the question and, furthermore, sorted it into 
superord inate and subordinate categories* A second student 
perceived the intended cognitive response as "CO think in my head 
**, or say it quietly to myself*'* Though the idea of reviewing 
material was apparent in this second student's perception, he made 
no use of information on the board* The cue to orient to a 
procedure failed, but the intended operation materialized 
nonet hi ess . Whether the cognitive product resulting from this 
response was as successful as it might have been if the student 
also had oriented to the chalkboard, as was intended bv the 
teacher, is moot* 

Acquiring content* Tn information processing terms, some 
instructional stimuli were intended to orient students to use i 
particular cognitive operations to work on information in their 
memories. Sometimes, teachers attempted to orient students away 
from acquiring specific content to applying a rule that would 
integrate the content* The instructional stimuli cuing this 
procedure were direct and explicit, such as writing the rule on 
the chalkboard. Students 1 perceptions of the intended cognitive 
responses cued by these instructional stimuli matched their 
teachers' almost exactly* For example, In Acton's class, an 
outline on the chalkboard signaled to students that they were to 
reorient theijr cognitive operations on materials being dealt 
with. Whereas in the preceding part of the lesson they had been 
generating ideas about a story they had read, the students now 
were asked to apply rules to describe how an author might end a 
story like this one, Another occasion where the teacher's 
Intention was to reorient students 1 cognitive operations in 
working memory occurred in Anderson's class when he wrote a rule 
on the chalkboard* Here, students said things such as* "(1 
should ) match them together , what 's on the chalkboard and what f s 
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in mv head," Overall, scudpnts ' v i pws of tht* intended cognitive 
response were congruent with Ac Con's, 

Commonly, teachers asked students to begin to monitor the way 
they were learning as a cue to orient their thinking strategies in 
working memory. For example, Lehraann often imposed specific time 
limits on tasks for students. He wanted students to know that 
they should monitor their cognitive processing (e.g."", applv n 
rule) to increase efficiency^ 4 student interviewed about this 
instructional stimulus had a % ,„ ral sense of this message, though 
his descriptions of the intended cognitive response were very 
vague (e.g. , "Don ' t fool around " } . 

The immediacy of these intended cognitive responses was 
clearly understood hy students, possibly because of the 
distinctiveness of the teachers 1 instructional stimuli* Students 
apparently had overlearned responses to most of these kinds of 
instructional stimuli, This probably accounts for the strong 
correspondence between teachers* and students' reports of the 
intended cognitive responses in this category. 

Storing content in memory . Orienting students to transfer 
the contents of working memory into long-term memory was common. 
In two different lessons, Orr used cues that appeared to be 
opposites even though he described the same intended cognitive 
response for both, In one lesson he asked, "Do you know what we 
will do next?" In another, he said, "Let's hack up a bit," Roth 
times, he intended students to switch from acquiring content to 
reviewing prior content and storing it. The students understood 
and made cognitive responses congruent with the teacher's 
intentions* For example, after the instruction to hack up, one 
student reported that she first re-organized the information she 
was thinking about, then recalled all the previous items in the 
order they had been presented so she could analyze them in terms 
of her new definition for the concept* Finally she used other 
students' answers to practice recalling the rule she generated, A 
second student gave an almost identical description* 

Not all instructional stimuli teachers used to cue this 
cognitive response were perceived accurately by students. 
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Students occasionally made intended cognitive responses even when 
the teacher did not c 1 early understand what he intended* Acton 
made a statement in one lesson: "Think really hard, " He 
described this as "It's Just an expression *** It means think hard 
, I don't know," Both students interviewed about this incident 
interpreted this as an instructional stimulus, One student 
believed the intended cognitive response was to orient to content 
that would appear on a test. He saidi "in a way it's like a 
threat , *, Start thinking or else you're going to fail," The 
second student also felt anxious and attempted to lessen his 
anxiety by reviewing what they had lust been studying so he could 
understand "what he wants us to do," Thus, even if teachers do 
not intend some events to be l ns true tional stimuli, students 
nonetheless may perceive and respond to events using cognitions 
they think are intended by the teacher. The differences between 
the two students interviewed about this event also supports our 
speculation that variability in students 1 on-the-spot cognitive 
responses to instructional stimuli may result in different effects 
of teaching practices on different students' learning* .Finally, 
this incident also illustrates the multidimensional nature of 
instructional stimuli as signals for intended cognitive 
responses* Not only was this instructional stimulus associated 
with orienting students to a procedure, but it also is clearly 
linked to orienting by arousal* 

Operating 

In the preceding section* there were examples of orienting 
responses which were to be followed by various kinds of cognitive 
operations by students* Most labels for acts of thinking (e.g. , 
attention, comprehension) describe a product of cognitive operation 
rather than operations per se. Our objective, however, was to 
describe the operations that students use in response to 
instructional stimuli, Thus, in this section, we avoid labels like 
"attention" or "comprehension" that describe cognitive products, 

A survey of about thirty books about human learning and 
cognitive processing suggested that there are three basic 
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operations that learners use in i ns true c i ona 1 settings; 
comparing* generating* and re-examining* These three operations 
may not be completely separable from one another. Achieving a 
cognitive product such as comprehension probably entails applying 
all three processes in varying amounts and sequences. 
Nonetheless, found this three^part scheme useful ,for analyzing 
teachers 1 and students 1 views of intended cognitive responses to 
instructional stimuli* 

Like orienting* operating also can he described in terms of 
size* i,e., the amount of information being operated on* and the 
immediacy with which the operations should be carried out. Though 
it is tempting to create a table that matches each kind of 
operating with the different levels of focus and immediacy* we 
believe the data and the classroom phenomena that they represent 
do not justify this sort of factorial arrangement* Thus* the 
following analysis reflects naturally overlapping and correlated 
features of students 1 cognitive processing during instruction, 
Comparing 

When the intended cognitive response involved comparing 
aspects of content to promote learning, it always involved an 
immediate cognitive operation. There were four basic kinds of 
intended cognitive responses that involved comparing. 

Unspecified comparing . This intended cognitive response is 
similar to orienting toward microscopic content, A cue on the 
chalkboard always served as the instructional stimulus, While 
teachers did not elaborate about the nature of comparing they 
intended students to undertake* hence the modifier "unspecified*" 
it was clear that students were to go beyond mere orienting to 
distinguish the cued item from others by using some cognitive 
operation* 

Students* views of intended cognitive responses to these 
instructional stimuli were varied, When Orr circled items on the 
chalkboard, two students said they were confused about the 
comparing Orr intended. Further probing revealed that one student 
had mastered the content under discussion but was not sure about 
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hnw the teacher's instructional stimulus was to be interpreted. 
The second student clearly noticed the instructional stimulus and 
indicated that he knew some sort of cognitive operation was to be 
invoked, but he did not know exactly what process should be called 
upon. Beyond these two kinds of confusion, a third student 
thought that he was to compare specifically the attributes of the 
item which Orr circled with the attributes of the items 
surrounding it on the chalkboard, Despite the lack of specificity 
in Orr * s tntenti one f this third student proceeded to engage in 
specific cognitive processing, This is another instance of a 
student engaging in processing not perfectly matched to processing 
the teacher intended, (in this case, the teacher was not clear 
about what was intended,) 

This incident showed that an instructional stimulus can 
communicate different intentions to students depending on their 
state of knowledge of lesson content, The first student 
interviewed understood the material, She did not perceive any 
need to make comparisons. The second student, who had not 
mastered the lesson content, was unsure about the intended 
cognitive response to the instructional stimulus, though he 
perceived that something was intended. However, the third 
student, who was consolidating content from the lesson, matched 
Orr's intention* He was at the appropriate stage of learning to 
profit from a cognitive response that was partly his own, while 
being generally congruent with the teacher's vague intention. 
Comparing codes . The teachers we worked with often were 
sensitive to how well students understood material, and how much 
of the lesson's material was understood, One way they showed this 
concern was by having students compare the meanings that 
accompanied different ways of coding information. Quite a variety 
of instructional stimuli cued this intended cognitive response, 
For example, in a lesson on anatomy, Richmond briefly described 
anatomical structures, then had students touch parts of their 
bodies. He expected them to be comparing attributes of the 
abstract concepts, presented in the lesson, with tactile 
sensations illustrating those attributes. 
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In addition to having students engage fn inductive actl vt ti es 



communicate this Intention, On one occasion* he strutted 
emphatically across the front of the classroom, intending to 
signal that students should compare his physical act ton with 
aspects of a question Involving a previously presented abstract 
concept, A student interviewed about this occasion clearly 
understood the intention cotmnuni cated by tMs instructional 
stimulus. f 

Researcher: Did you understand why he was doing that 9 * 
Larry: Because he was walking and trying to prove something. 
Researcher" He was walking, and you said f when he asked you 
for an example, you said "walk" didn ? t vnu? Do you remember 
how you came up with that exaftiple 9 

Larry: He was walking across the room, back and forth, 
Researcher: So why do you think he was doing that? 
Larry: To give us an answer. To give us a hint. 

In another example, Acton wrote equivalent forms of fractions 
(e*g* f 1/4 ^N # 25^ close to, one another on the chalkboard* He 
intended the proximity of the two codes to cue students to use the 
two different codes for representing numbers. Both students 
interviewed perceived this comparing process, describing it first 
as using a familiar code to identify critical attributes* 

Researcher: Can you tell me how vou were thinking, or how 
that helped you think about it 9 

Ksthy: He went back to the fraction, you know^ and without 
changing to decimals it makes it easier to think more — it's 
much easier to concentrate on it, 

* 

The teachers used obvious cues to inform students that they 
should compare codes* Students rarely misperceived these 
Instructional stimuli and t as long as they had the knowledge to 
compare, had little trouble doing the comparing* 



to compare codes, Anderson also engaged in activities himself to 
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Comparing attributes. The operation of comparing codes Is 
similar to that for comparing attributes that define concepts, 
Whereas the previous category pertained to attributes for a single 
concept, this category involves comparing attributes across two or 
more concepts* 

• When teachers cued this process, they intended students to 
focus Immediately on content at a microscopic level* For example, 
in a grammar lesson, Acton read sentences to students after 
instructing them to "listen*" The students * task was to identify 
adjectives and adverbs and compare their descriptive qualities in 
preparation for a later writing assignment* The students 
interviewed perceived this cognitive response as Acton intended* 
One student said he had a prototype of each concept in his mind* 
Upon hearing a particular descriptive word, he tried to examine 
that word in terms of the attributes of his prototypes* 

Researcher: Can you tell me what you were thinking as he was 
going through that 9 

Bob: Well, right away from the first couple of lines of the 
paragraph T knew the kinds of words that I was going to use 
and so T was pretty well ready to write from there* 
Researcher: So that his reading th^t right at that point 
helped you to identify the kind of words you might need 
later 9 
Bob: Yeah* 

Researcher: I'm trying to find out if you were just 
concentrating on the words he was saying and identifying, 
" that f s a good word and that's a good word," or whether you 
actually were picturing what the whole example was about 9 
Bob: It was kind of a little bit of both and when T heard 
certain words, right there I knew that those were some of the 
words that T wanted to hear* But t like to take the whole 
thing in general and 1 oo^ back over it after I have heard it 
and then T think about it just before T write down what I ? m 
going to write* 
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Researcher i Was tt clear to you that you ware supposed Co be 



Bob: I don't know t f that was what we were exact! y supposed 
to do* I just thought that he just did that to give us a 
good Idea to start us with what we are going to try to do 
with the words* 

Researcher: Does that help you to learn* if he reads an 
example to you^ 

Bob: Yeah, it does for me because* like T said before, T can 
pick up the things that T want to use and put them into my 
own words and examples. 

In another lesson Acton had very recently been asking 
students to describe why they chose to discuss certain items as 
opposed to others* Then, he abruptly asked students why they had 
not chosen to examine other items. By asking students to focus on 
the criteria they used In deciding not to discuss a particular 
item, he intended them to compare these criteria with those they 
had used to select other Items so the latter would become 
clearer, We interviewed three students about this event* None of 
them described cognitive operations very congruent - wi th Acton's 
intentions* Two students had no idea why the teacher had changed 
the focus of the activity, so the^y decided to treat Acton's remark 
as a discrete question rather than one related to the previous 
work they had been doing* They had little idea what was intended 
by the current activity, nor could they predict what would be 
happening next in the lesson* The third student, however, 
perceived that Acton bad an intention for some cognitive 
processing, but he understood his cognitive task to be one of 
isolating a separate set of attributes that would appear in his 
and other students* answers to the teacher's new question* 
However, he did not perceive that he was to make direct 
comparisons between the set of attributes currently being 
developed and those that had been developed earlier. Thus, he was 
unable to relate the new activity to the previous task, and 
thereby failed to highlight the basis for classifying items. 



listening and picking out those words? 




The teachers often read material to students * One such 
occasion occurred when Anderson read sentences in which "to," 
"too," and M two , * had been blanked out. He Intended students to 
compare the semantic attributes of various sentences and use them 
as a basis for deciding which form of the word to use in filling 
in a blank. One student we interviewed about this was candid in 
admitting that, M l knew what we were going to he doing , I got 
kind of confused . .* 'cause I was kind of fooling around," 
However, in defence of this student, we note that he also said he 
did not need to pay attention at this particular point in the 
lesson because he knew the correct uses of these words, Here, 
again, Is an indication that a student's perception of the 
cognitive processing a teacher intends can be conditional upon the 
student's mastery of content under consideration* 

Finally, one incident belonging in this category illustrates 
,e earlier speculation that students can generate their own 
interpretations of instruct f onal stimuli when these intentions are 
absent or vague tn the teacher's description* On this occasion, 
Acton was asking the students to relate sentences they had written 
to a picture that had served as a focus for the writing 
activitv, His description was, f *T don't know how they'll be 
thinking about it here, just be putting it all together," Tn 
response to probing, he suggested that the students should have 
been comparing attributes of the material they previously had 
written with the concepts presented in his questions. The student 
interviewed about this incident had quite a different perception 
of the cognitive activity intended by the teacher* He attempted 
to store in memory other students' answers because he believed the 
teacher's questions would be asked on a later test. Because he 
was occupied with trying to remember the other -students ' answers, 
he said little else was being done. Thus, the student was clear 
but Incongruent with the, teacher on this specific occasion when 
the teacher was not very certain about how students should be 
operating on content, 

Using rules. When teachers asked students to apply rules to 
new examples, we categorized these events as comparing because 
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teachers and students indicated chat students were to compare the 
steps of a rule with characteristics of thn particular example to 
which the rule was being applied, For example, in a lesson on 
fractions, Lehmann developed a step-hv-step example .on the 
chalkboard, calking about each step as he went and emphasizing 
what would follow each step. He wanted sttHencs co predict the 
next step based on the preceding step. The student Interviewed 
said he was comparing the steps of the rule he had learned for 
working with fractions with those being illustrated on the 
hoard. His prediction for the next step involved comparing what 
needed to be done to solve the problem with the information 
provided up to that point, 



Not all students accurately perceived teachers fX intended 
cognitive responses involving rules. Following the presentation 
of a complicated rule, Orr asked several questions of students\ ^ 
none of which produced answers, He then said, "That's tricky; let 
me back up." He intended that students would compare attributes 
of the rule he had presented earlier with the material that was 
going to be re-examined. One student indicated she understood 
that previous answers were wrong, and that sh^ needed to 
understand the steps in the rule. However, rather than analysing 
earlier examples in terms of the rule; she perceived that the 
intended cognitive response was to orient to the next answer Co 
seek attributes of it that could to be compared with the rule, A 
second student *s intended cognitive response was congruent with 
Orr's. He reviewed the rule and tried to predict exarnpl e<? that 
might fit this rule. 
Generating 

Intended cognitive responses for generating new content 
involved either generating a new way to represent content, or 
generating new content per se based on procedures or information 
provided in the lesson, The^ former were rare, hut there were a 
number of incidents Mn the second category. 

Generating codes . Some teachers believed students would he 
able to acquire or retrieve information more easllv if they had 
more than one way of cognitively representing that information. 
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Unlike the comparing codes response described before, where both 
coding schemes for comparison were already avail able, here 
students were to create a new code. 

A prototyple Incident was where students were to create a 
mental ,„,,<-,. Before defining "concave," Orr asked, "Where do 
bears sleep?" He thought students would create an image of a cave 
that would help them remember the definition. Both students we 
interviewed noticed this odd question and understood that it was 
supposed to provide a device for 1 earning the definition. 
However, neither perceived that this device was to be an image. 
When Orr clarified this by describing the Image he intended 
students to generate, both students then said they recognized this 
as the image that Orr intended them to create originally. 

Generating rules . The teachers frequently tried to cue 
students to generate a rule that could be applied to content. 
This process closely resembled hypothesis generation like that 
used by scientists. The teachers always assumed that students 
understood how to use such rules. Nowhere in their classroom 
behavior nor in the* r descriptions of their intentions For 
students' cognitive processing did they indicate that students 
might not have been aware of the form for a definition, an 
hvpothesis, or a rule. 

As one example of generating rules, Anderson expected 
students to create a rule about transitive and Intransitive verbs 
as he categorized examples of those two verbs on the chalkboard. 
The student interviewed about this said, "He was trying to get us 
to fit the right ones," a weak concurrence with the teacher's 
intention. 

tn another example, following a discussion about stories and 
how to 'write them, Orr asked questions about how to end a story. 
He intended students to create endings by first devising a rule 
about the story's plot and then applying this rule. The student 
Interviewed indicated he was baffled by the teacher's 
instructional stimulus. Although he understood that the story was 
to be ended, he had no idea how to go about it. 



On two occasions where the. Intended cognitive response was to 
generate a rule, the instructional stimulus was something written 
on the chalkboard or an Incomplete sentence that would define a 
concept when completed, We considered these definitions to he 
rules because they could be used to classify Instances and non- 
instances of concepts, Students* 1 nt erpretac * ons of their- 
teacher ? a instructional stimuli depended on whether thev knew when 
processing was complete. Tn Orr's class, one student said he did 
not understand why the teacher had wri t :en an incomplete sentence 
on the, board, A second student told us she believed she was to 
guess what might go in the bl ank , but she did this without 
referring to previous lesson content or to a rule that could make 
this task less hit-and-miss, A third student, however ; described 
the same Intended cognitive response as the teacher, namel v, to 
complete the sentence and test Its adequacy against information 
presented earlier in the lesson. 

Students* interpretations of instructional stimuli that cued 
rule generation 1 were clearly related to their understanding of the 
lesson content preceding these events. Students who were at the 
point where a rule usefully summarized what thev had learned 
seemed to achieve fairly high congruence with the teacher's 
intended cognitive response. When their understanding was 
incomplete, students could not evaluate how successful they were 
at completing the : 'task, A typical strategy was to wai t for other 
students to complete the task. Their reluctance to ask questions 
about the meaning of these instructional stimuli appeared to be 
not so much an attempt to avoid displaying their ignorance as ft 
was reasonable strategy for getting the needed information. 

Teachers also Intended students to create hypotheses. This 
differs slightly from rule generation because a rule could be used 
immediately and systematically following 1 ts generat i on whereas an 
hypothesis would become the object of further testing. 

Tn a science lesson, Richmond asked students to guess the 
relationship between two variables bv generating hypotheses, 
Students described a variety of cognitive responses to this 
instructional stimulus. One student interpreted the instructional 
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HtimnluM to mean that ho should "think harder f 11 which meant "to 
think over and try to rfmemher" some of the preceding content, 
When asked to elaborate, the student said that he was to respond 
with a guess f hut he did not know the criteria that determined ■ 
what qualified as a good guess, A second student f s interpretation 
of the instructional stimulus went beyond the cognitive response 
Richmond intended. This student not only created an hypothesis 
about the relationship between the two variables, but believed he 
would be expected to "tell why" this hypothesis was likely to be 
true* 

There wafe considerable variability in students 1 
interpretations of instructional stimuli that teachers intended as 
cues for students to generate an hypothesis. Part of this 
divergence seemed to arise because students did not know when 
their hypothesizing was adequate. Those students who could judge 
the adequacy of their thoughts also seemed to understand how to 
generate hypotheses* Occasionally, these students even, went 
beyond the teacher 1 s intended cognitive response to question the 
validity of the hypotheses they had generated* When their 
understanding was incomplete or absent, the task was relatively 
opaque with respect to the cognitive operations the teacher 
intended students to engage* For students in this situation, a 
typical strategy was to sit tight and wait for other students to 
complete the task. It appeared that their reluctance to interrupt 
the Wesson with questions about the teacher's intention was not so 
much an attempt to avoid incriminating themselves as it was 
reasonable strategy for getting the right answer, On the other 
hand, students who were at the point of acquisition where a rule 
could be useful in summarizing what they had learned seemed to 
achieve fairly high congruence with the teacher's intention. 
Thus* instructional stimuli that cued students to generate either 
rules or hypotheses varied in clarity as a function of two 
factors- whether the student's mastery of content was sufficient 
to complete the task; and, whether the student could judge when 
generating was sufficient. 



Using; Metacoenltl on 

Metacognition refers to thinking about the processes and 
outcomes of thinking. Several forms of menacoen i ti on appeared in 
response to instruct! nnnl stimuli, nil of which were macroscopic 
in focus. There were two functions for metncogn I ti ve responses. 
One was to monitor cognitive operations on content to insure that 
the cognitive strategy being used was the one int ended hv the 
teacher, The second function involved something students were to 
do upon completion of monitoring. One some occasions, fhev were 
to provide feedback to themselves about 1 earring. On others, thev 
were to generate for themselves a motivational consequf nee based 
on their performance. 

Monitoring. Teachers frequently intended students to examine 
the cognitive procedures they were using at particular points 
during lessons. For instance, in a math lesson, Richmond 
summarized a complicated principle hv drawing a diagram of the 
principle. He intended that students would monitor the extent to 
which their sequence for applying parts of the principle matched 
his diagram. Specifically, students were to examine whether a 
preceding part of the principle cued a subsequent part. The 
students interviewed could not do this because they had not 
mastered the components of the principle. ^hus, thev could not 
use them as cues for subsequent components. Although the students 
had a general idea that they were to be monitoring their thinking, 
they treated each element as an individual entity. When asked 
what he did when he didn't know a component, one student said, "T 
erase the whole thing and start over." Monitoring whether he was 
applying components of the principle in sequence while trying 
acquire the next component \ms beyond his existing state of 
knowledge and the capacity of his working memory, 

Tn a somewhat similar situation, Acton was summarizing 
content In closing a recitation lesson. His intention was that 
students would monitor their seat-work act ivi ti es using the schema 
he modeled while presenting the summary. Though this 
instructional stimulus and the one lust described for Richmond , 
both occurred at the very end of a lesson, they differed with 
respect to immediacy: Richmond intended students to engage a 
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mnnfror I nr. operation s * mul taneousl y wi ch Ms presentation while 
Acton intended students to apply this procedure at a later time. 

Intended metacosn* tlve responses were applied in the service 
o^ acquiring material as well as reviewing or applying it. 
Typically, .this took the form of students answering example 
problems For instance, when Acton did exercises Illustrating how 
to change fractions to decimals, he Intended students would 
monitor their use of rules For answering the exercises and compare 
their procedures *n th the one he was model ing. The three students 
interviewed all. perceived this intended cognitive response. One 
student put it quite eloquently: "He's up there for a reason ™ 
so we can think about what our answer is and how we do it." In a 
somewhat different vein, by providing incorrect examples, Anderson 
wanted students to monitor the rules they were using to classify 
instances of a concept. He believed that by monitoring, students 
would discover a relatively common mistake and remember that it 
was to be avoided. The student interviewed about this incident 
also described cognitive activity in consonance with the teacher's 
1 ntent f on . 

Only rarely were students baffled by an instructional 
stimulus cuing them to monitor. The few failures were due to > 
lack of content knowledge. When the content was not well learned, 
students focused on acquiring the content, not monitoring. This 
seems sensible since it is difficult, if not impossible, to 
acquire content and monitor Its manipulation simultaneously. 

Appraising - Teachers were aware that students judge what 
they know and that they react positively or negtively to those 
judgments. Teachers sometimes used instructional stimuli to cue 
students to do this. At the an A of a lesson, Lehmann asked a 
student to summarize what had been covered. He intended that the 
student doing the summary would monitor the extent to which he had 
mastered the content. Where the student judged that mastery was 
Inadequate, there was an unstated requirement fhat the student 
would request help from the teacher or peers, Tn Lehmann* 3 view, 
this procedure provl ded conf i rma ti on of mastery and an Incentive 
for monitoring. All the students interviewed about this 
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instructional stimulus indicated £hat thev understood the Intended 
cognitive response regarding both knowledge and affect. 

An interesting illustration of Orr ? s intention for students 
to engage in Appraising Following metacogni t J ve activities 
occurred in n recitation setting. He had been asking a series of 
questions about a complicated principle, none of which the 
students could answer to his satisfaction. When Orr was asking 
these questions, he expected students to he monitoring the 
cognitive procedures they were using to produce answers fas well 
as usin^ rules- see the section on this nperat^on), Upon seeing 
that this was impossible because students had not acquired the 
content whose manipulation was to be metacogni ti vel y monitored, he 
said, "That * s tricky; let me back up." His intention concerning 
the first part of this phrase was that students should examine 
their feelings about their inabil it:v to provide answers and 
attribute failure to the difficulty of the task and his poor 
lodgment about the extent to which necessarv content had been 
acqui red -. 

The two students interviewed about this pvent had quite 
different understandings of Orr f s intentions concerning appraisal 
operations. Both Indicated clearly that thev knew something was 
wrong when no one, Including themselves, could produce answers to 
the questions. Neither indicated that they were engaging In 
metacogni tlve monitoring, which confirms our prior speculation 
about the i nappropri at eness of this task when content has not been 
acquired. One student understood Orr's statement to mean that he 
should stop trying to answer the questions and note Orr's next 
comments as the answers to the previously unanswered questions. 
The second student understood Orr 1 s statement about changing the 
direction of the lesson as a cue to revi ew the previously 
unsatisfactory answers for common elements. Thus, the teacher s 
intention that students' attribute their failure to task 
di f f tcul ty was not perceived hv these two s t udents . 

Consoi i datl ng 

The third major class of intended cognitive responses 
pertained to storing and retrieving information. These activities 
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rvpf raHv .irr operat f onnM zed in activities chat involve 
practice. T ho Feature* d i s t i ngul shi ng consolidating from the 
preceding cognitive processes (i.e., comparing, generating, or 
metacognt ti vet v examining cognitive procedures > is that teachers 
expected that students must already have comprehended lesson 
content prior to consolidating It, In contrast, the cognitive 
operations discussed earlier were intended to promote 
comprehension per se, 

There were two components of consolidating. One was simple 
rehearsal. A second was to practice procedures for retrieving 
information based on cues similar to those presented in the 
lesson, TMs produced either verbatim recall or transfer 
depending on whether cues were the same as p or different from, 
information presented in the lesson. 

Teachers believed that rehearsing and practicing retrieval ■ 
strategies would increase the dlsti ncti veness^ of information, the 
probability that information would be retained, and students* 
ability to retrieve information if they were given cues. This 
description is similar to contemporary theories of storage and 
retrieval Cr.g. , Hague, 1^78; Haver, 1979), 

Consolidating operations occurred throughout lessons. 
Lehmann began one lesson hy having students discuss among 
themselves procedures they would follow while working later In 
small groups. In addition *to orienting students to lesson 
procedures, he intended that they would recall and rehearse the 
skills involved in small group work, Students Interviewed about 
this event perceived this same cognitive operation. 

Instructional stimuli cuing consolidating operations also 
were used as teachers developed the content of lessons. In a 
vocabulary lesson, Acton told the students to "just jump right in' 
after presenting the third example of a concept, intending 
students to practice retrieving and applying a previously learned 
rule, One student H pa. 1 v marched this intended cognitive 
response. He knew what the rule was an 3 said he was going to 
apply it again, "because we already know the process to get it," 
A second student, though he knew what was intended, did not make 
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the cognitive response because he Hid not understand the rule to 
be rehearsed, 

As might be expected, students* perceptions of consol i dat t ng 
responses to instructional stimuli were not always all that the 
teacher might have wanted, Lehmann frequently asked students to 
check with partners about their understanding, sometimes as often 
as ten times during a 45^minute lesson. His intention in one 
arithmetic lesson was for students to retrieve rules and rehearse 
the sequence involved in applying the parts of them, A student we 
interviewed about this event understood Lehmann' s intention and 
felt competent in executing the consol t dating processes, adding 
that his first step was to select the easiest aspect of the rule 
to retrieve and rehearse, thereby making the task easier. 

The majority of instructional stimuli that cued consolidating 
responses occurred at the end of lessons or as transitions from 
recitation to seatwork. In most situations, students understood 
that they were to consolidate, though sometimes they were confused 
about whether to rehearse or to practice retrieval given cues. 
For example, in one lesson Anderson spent extra time reviewing, 
intending that students would practice their retrieval strategies 
and highlight the differences atrong items. Though both students 
interviewed understood that consolidating was the objective, 
neither knew how to proceed because they did not know the specific 
processes to use to consolidate lesson content. This was not 
always the case, however, By presenting steps in a rule very 
slowly, Richmond expected students to be rehearsing each step and 
improving their recall of each step by linking it with previous 
parts of the rule. The student interviewed about this event 
indicated clearly that he viewed his task as practicing each step 
and relating it to the preceding step. 

On one occasion, Acton told his students to use a rule over 
the weekend that they had developed in class. He intended 
students would consolidate their strategy for retrieving the parts 
of the rule and rehearse its components. One student remarked 
that she understood the teacher's intention, hut she wou 1 H not do 
it. In her words: ''Well, T would just look at it an i then try 
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nnd remember ft for Che weekend. T don't think T would do 
anything Wke trying to convert it or anything ~ T would just - 
keep it in mind." A second student had the same reaction. Thus, 
unless the teacher can create tasks that control whether students 
make consolidating responses, students may not make those 
responses even when thev know what to do. 



We constructed a complicated system to represent the range of 
intentions that teachers had for students* cognitive processing of 
content in lessons and to reflect students* views of the cognitive 
processes they perceived were intended by their teacher* This 
system contains three major categories: orienting, operating, and 
consolidating* Orienting and operating each were further divided 
Into three suh-^categori es p and these 5 in turn, were divided 
further Into a total of eight tertiary classifications (see Table 
2)* Clearly, both teachers and students in our study reported 
that teachers used instructional stimuli to try to manage a large 
variety of cognitive operations they believed mediated students 1 
1 ear n f ng* 

The findings about teachers' and students' views of students' 
cognitive processes for classroom learning have several important 
implications* First, there was a noticeable lack of one^to^one 
correspondence between cognitive responses teachers associated 
with instructional stimuli and the cognitive operations that these 
stimuli cued for students* This suggests that research using only 
classroom observation schedules as the basis for generating 
explanations about how teaching affects learning may distort the 
ways in which these phenomena interact* Whereas observation 
schedules require that instructional events* be defined as distinct 
if they differ in behavioral structure, teachers and students may 
treat them as functionally equivalent in terms of Intended 
cognitive responses* And, while some instructional stimuli may 
appear superficially similar at the behavioral level, they may 
produce qui te di f f erent cogniti ve responses by students . 
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Thus* any analysts of classroom instruct*^ that does not 
account for —he dynamic nature of the mn f ci ve milieu will 
probably dise-rort the phenomena of Interest. Tn practical terms, 
if teachers rfo not communicate clearly the relationships between 
what they af^ teaching, how thev are tPflchf ng , and how students 
should be th-^f nking, students' 1 earning may not he optimal, 

A secon.fid important finding Is that the teachers and students 
we i ntervl ew^d did not presume that ail teaching events lead 
directly to learning. Teachers used fnBtructi onal stimuli to 
prepare, ort^nc, guide, and ocherwl se invol ve students with 
information ^before students were to learn per se, and students 
perceived str-nilar 1 nt ended eognl tive responses to instructional 
stimuli, Insofar as we know, such "supportive" or " pre pa rat or v" 
teaching eve nts have been investigate^ rarel y in classroom-based 
research on teaching. Separating supportive or preparatory 
Instructional! events from those intended to produce learning 
directly may be a distinction to be pursued In future research. 
This dlstlnc tion al so may prove to be useful In classroom 
instruction ^designed to help students become more deliberate in 
their use of different cognitive strategies to achieve various 
goals. 

Turning to the findings about students 1 perceptions of 
instruction* 1 stimuli* five salient generalisations emerged from 
our ana 1 yses of students* understanding of the intentions teachft =rs 
tried to cotenunicate during instruction hv us^ng instructional 
stimuli. Ft -rst , there was a strong probability- that students 
would not nr. curatelv perceive a teacher's instructional stimuli 
that signal <f students to use orienting operations. This occurred 
espeel ally w-Tien teachers attempted to promote affecti ve states I 
students, T^o a lesser extent, mismatches of this kind al so. 
occurred wh & n teachers used procedural cues to orient students r <^ 
using externs.al materials to support learning, or toward cognl tiv- « 
operations Tor storing content. The bade feature character! z i_r\ & 
these incongruities between teachers 1 intent! nns and students' 
perceptions of appropriate cognitive responses was that students 
mi spercei vecE the immediacy of operating on content or the nature 



of rho cognitive produce to be created, Tn these events t students 
focused on prncp R^tnp, the content in the Immediate task rather 
than nrtfnf ^ hp, the tenches intended, toward affective states 

or rnncent to be? presented later, 

A maior feature of students* cognitive responses to 
instruction was chat the charity with which they perceived the 
teachers* intent i ons in instructional stimuli often was inversely 
proportional to the amount of Information which students had to 
cognitlveiy process. When the focus was a macroscopic unit of 
content, such as a rule or a complicated cognitive operation^ 
there was constderabl e variability in the accuracy of students' 
perceptions of the instructional stimulus * This Is yet another 
Affirmation of the principle that people have limited cognitive 
capacity fsee Cal fee, 1 §81 When students were not overly taxed 

the newness o r~ compl exitv ^ f the material s they were rel atlvel v 
wore accurate in perceiving the teacher 1 s intentions and reporting 
that they could successfully carry out the cognitive operations 
teachers communf cated via instructional stimuli. 

There is an important qualification to this finding that 
constitutes a third salient feature of st{jdents ? cognitive lives 
In the classrooms sampled for this study. When students had a 
veil-practiced ott automatic cognitive response to an instructional 
stimulus 5 teachers' signals about how students should cognltlvely 
deal with lesson content were clearly perceived* Moreover } 
students reported they felt very adept at carrying out the 
teacher's intentions for cognitive processing in these 
Instances . Whert instructional events were of this type, then 
students seemed to have little difficulty in wrestling with very 
complicated cogn 1 tive processing such as many-stepped rules or 
meEacogni ti ve monitoring* 

A fourth maior finding was that the ability of students to 
undertake cognitive processing that teachers signaled by 
Instructional sc Iniul 1 depended on their mastery of content at the 
time* When students were directed to engage in almost any 
subcategory of operating or consol idating* the extent to which 
they had comprehended prior lesion content "was a fairly good 
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predictor ot the accuracy with which tlify parent ived the teacher's 
instructional stimulus, 

This finding appears paradoxical. If s c i <? n t s are less able 
to use a particular cognitive proc^sr* 'tat ^^olops knowledge 
because they do not have that know! ertoS htw d,--, 0 rhev ever acquirn 
this knowledge in the first place 0 ^As pointed out earlier, a 
particular instructional stimulus caficue di f erent cognitive 
responses for different students. Tti^h stud^ ents might not use 
the particular cognitive process int^y hv tHhe teacher, they may 
use another Chat produces relatively e<iuival en^ t knowledge, Tn 
this sense, there may not alwavs nee^^ he a o one-to-one 
correspondence between teachers* instructional stimuli and 
students' cognitive responses - Sinc^wdid ri Oi0C collect 
achievement data, we have no ground for claimi 0 rig the cognitive 
response intended by the teacher* an* 1 ^lv thi g 5 cognitive 
response, is the most effective way for studen-nt s to learn 
content. This is another reason why future res-search on teaching 
must attend more carefully to the cognitive !U fe of classrooms 
since most current views of a teache * behavior - are rationalized in 
terms of only "one kind of cognitive response Woy students, 

The third and fourth findings j mi discus. : ^ s ed show the 
important interaction between fac coks that cogu S ni Cive psychological 
researchers label the state of prior knowledge and the 
automatic ity of executing cognitive plans. !A-nen students suffer 
from a lack of content knowledge ne^il to pro.oceed with an 
instructional task, their facility ryircj* ^ out complex 

processing tasks cannot compensate for this ^^ficifincy because the 
information to be processed is unavailable. T "ffn this case, 
attention to instructional stimuli probablv de felines because 
students* cognitive resources are i revested in building 
representations of new content in short- term ntrmemory . Hence, 
instructional stimuli are unlikely £0 be strc?n ng influences on 
students' learning when students haye underdev we 1 oped knowledge 
needed as a prerequisite for the eor^nt he i rt%-^ delivered in 
lessons* Tn turn, their reports ah@ul teacher sr& 1 intentions for 
cognitive processing should be vagu# w of f-Cu^r ge t , This is what 
we observed- 

SI 
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When students have necessarv Uveis 9 f pHot^ knowledge, the 
automat Icltv with which they can ca^ry o llt c °snt tz=i ve strategies « 
for learning a^ so might he related to tH^ prohabill 1 itv they 
accurately perceive teachers' intentions for thelZlr eognit* ons as 
manifested tn Instructional stimuli. A^tonacic cognitive 
strategies require fewer cognitive resQu^ to ^sxecute, 
especial! v as regards space in working vW- ^hi s unused space 
may he devoted to any number of tasks, cf^ Df whd ch may he making 
maximum use of guidance provided by insc^ions^ stimuli. Thus, 
students who have prior knowledge that ^NuppQtert new learning 
and who have automatic cognitive strategic to undertake tasks 
that promote learning should be in the ^eit pogittion to profit 
from instructional stimuli. This, too, h*at we observed 
students reporting about instruction* 

Also, when something in the instructional environment 
disrupts automatical Iv executed cogni tttf* ^trace ps^l as f such as an 
unexpected instructional stimulus Chat r» not e^it well into the 
cognitive strategy, students probably wf« report confusion about 
the meaning of the instructional stimuli ?hts hypothesis was 
a 1 so supported in our data* 

The presence of automat i city in leers' cognitive responses 
leads to a methodological problem, Aut^tle productions are 
generally not available to conseiousnes^i^ wni*cb we mean that 
people are not very aware of how they a<e nan I pu~2 ating 
information, We usually cannot think a put the ^automatic 
procedure when we perform ft without d l^™Ptinff —the procedure to 
some degree. Thus, stimulated recall m^ttodolOftry as used ln thl 3 
study may have serious limitations far f-^tiga tiing automatic 
cognitive procedures students use in cl^womtf* 

Indeed, such procedures may introdtJcea p^r^adox. In some 
contexts efficient learners, those who g^Y Somatic 
production, may not be able to give verfW se lf-reports of 
their cognitive processes, while less extent learners may have 
more access to these procedures simply ^ tJUSe t^hey are not 
automatic, Thus, the findings reported mi ft *ht be biased in 
the direction of less efficient 1 earner^ The «* ore graphic 
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ex ampl ea of cognl c ! vff process in si ran the part of students in this 
study may have come from those students who were less efficient. 
Of course, without both achievement data and evidence nf cognitive 
processing during acquisition (i.e., during the actual 1 essons wo 
videotaped^, this remains a speculation. 

These analyses and hypotheses also relate to another 
distinction often made in cognitive psychology between declarative 
and procedural knowledge, The former constitutes the "static" 
content of memory that is representative of the structure of the 
subject matter a student has learned. The latter refers to the 
cognitive operations underlying the ability to perform an 
intellectual task. The two kinds of knowledge are not 
independent, The state of a learner's declarative knowledge will 
influence the cognitive procedures that he/she will be able to 
perforin ( Shave 1 son , 1981), The relationship between the two forms 
of knowledge is exemplified in the data reported here by students 
who were apparently unable to execute particular cognitive 
processes because they had not learned prerequisite content. But 
as declarative and procedural knowledge are applied over time % 
both can change. Thus, the procedural knowledge that is linked to 
declarative knowledge at a time (X + 1 ) mav not be the same 
procedural knowledge that served to create that declarative 
knowledge at time X. In turn, older instructional stimuli that 
were perceived accurately at time x may lead cognitive processing 
astrav at time X + 1 if they cue inappropriate procedural 
knowledge, " ' 

Finally, students appeared to be strategic in the cognitive 
processing they used as they attempted to learn from teaching. On 
those occasions where the teachers did not /describe clearly their 
intentions for students 1 cognitive processing, and even on some 

occasions where teachers said tHey had no clear intentions, 

/ 

students nonetheless made cognitive responses to what they 
perceived to he instructional stimuli. This is particularly 
crucial, not only because it relates to a central assumption of 
the cognitive mediational paradigm, but because it suggests that 
students will construct meaning for classroom activities 
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rcft«irrtl esa of whether the teaCh „er (or an instructional theorist) 
does* Failure to in CDr Porate t h i s student variable into research 

on teaching mav lead to misrepi esentations of how students learn 

from teaching ther^Y Hmitirt* r the completeness of theories of 
teaching. Whether tfiis oniissi o-r also will limit the ability of 
researchers to devejflp useful p rescriptive theories of instruction 
must await exper ini©n tal evidence e , 

A significant c «it needs to he made regarding this last 
conclusion about stufb^ 1 stfa tegically active cognitive 
processing in class r «, Stf^.ulated recall methodology does not 
test whether .part ici pants ' rgpOT=rts validly reflect the events that 
are being probed, T^ed* it is s possible that participants 1 
responses to quest i ofiNurin^ s- timulated recall are constructions 
about what they might have been doing or would do if given another 
chance. These consttiiUions cH^nas, may not be the same as actual 
cognitive processing 'luring the event. More research is needed at 
this point. Hypotheses about tEThese phenomena should be tested in 
experiments where stents ' str^ategic cognitive processes are 
operat ionalized by ^ Crimen te^.-s to become independent var iables 
(for example, see Wifino& Ha r x» 1980; Winne, 1 982 a, b) . The * 
findings produced hy a methodo le^ogy like that employed in this 
study can be used to create hypQ^Qtheses for such experimental 
tests, but thev cannot con fi rm disconfirm these hypotheses, 

OoHC ELUSIONS 

5 

This study demonstrates c^sat students mediate instructional 
events with their cognitive progressing,, thus supporting the 
cognitive med tat ion^l prad'igm ^mss a heuristic for research on 
teaching; The range of teachi npss; studied,, in this project was 
limited because the ^nly lesson^s we. observed were recitation 
lessons* Obviously, this samples of lessons does not represent the 
full range of cl assroom teach i^^m strategies. The cognitive lives 
of students descr^h©^ fiere may r-noc generalize to the diverse %orms 
and settings for tea^in^ thac &an be found in today's schools* 
Nonetheless, we bet i#ve that th^^ phenomena described here provide 

a useful beginning; fa* invest i Leslie ions of these other settings. 

i , 
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Future research will have to improve on our procedures for 
soliciting descriptions about cognitive operations from the 
teachers and students. While occasions where n student or teacher 
was eloquent and. precise in describing cognitive processing 
provide support for the existence of these phenomena, it is 
possible that our methodology may have overly structured these 
descriptions. Although this difficulty is inherent in the 
procedures for collecting and analyzing data that we used »n this 
study f we hope that the opportunity to improve on the precision of 
pur findings will stimulate further research. 

Finally, it is important to emphasize that this first study 
did not unvestigate the relations between students 1 perceptions of 
instructional stimuli, their competence at executing associated 
intended cognitive processes, learning, and teaching effectiveness 
as reflected by students* achievement, This research is extended 
in the three studies that follow to examine relations between 
students* perceptions of instructional stimuli and their ' 
achievement that results from instruction. This extension is 
necessary for the cognitive mediational model to provide a basis 
for prescriptive theories of teaching, that is, statements about 
the causal relations between teaching events and students* 
learning that ough_^ to be Followed to improve education. 

We are convinced from these data, our own previous 5 
theoretical and empirical work (Marx & Winne, 1331; Winne & Marx, 
1977, 1979), and the work of other researchers in this area 
(Corno, 1981; Doyle, 1980; Shave! son, 1981; Weinstein, in press) 
that experiments regarding the cogni tive mediational paradigm are 
warranted. Such experiments must meet a number of requirements in 
orcle^ to test the validity and utility of a cognitive mediational 
Jramework for research on teaching, 

First, instruction must be designed and del iwered in such a 
way that the teacher 1 s (or researcher * s ) intentions for students' 
cognitive processing are clearly communicated to students. We had 



ample' evidence from this study that when teachers hold ambiguous 
intentions or when they are unable to communicate their intentions 
clearly, students* thinking can vary substantially, 
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Second , students need to perceive the occurence of the 
Instructional stimuli that communicate these intended cognitive 
responses and they have to be able to execute the appropriate 
cognitive responses when thev are needed, This second requirement 
carries several methodological implications. Instructional 
stimuli need to he salients Students should have sufficient 
practice discriminating the instructional stimuli and executing 
their associated cognitive response so that these cognitive 
operations can lead to efficient learning* Evidence must be ^ 
collected that the cognitive responses are executed as intended, 
Documentation providing this evidence should he constructed in 
such a way that logical ly, one would have to perform the intended 
cognitive operation in order to produce the evidence, say notes in 
a notebook, A final methodological implication emanating from 
this second requirement is that evidence should be collected of 
learners 1 prior knowledge of content to be learned in the study. 
This relates to the declarative-procedural knowledge relationship 
discussed earlier. 

Third, a .program of research should show that the control of 
students cognitive mediation of instruction can occur in the 
complex environment of school classrooms* as well as in the more 
rarefied and controlled environment of the laboratory, This last 
requirement is the acid test of educational research* and is 
particularly necessary for' research on teaching* One of the major 
strengths of the process-product model of research on teaching is 
that most of the empirical work took place in classrooms. While 
from our vantage point" the findings that emerged from the process- 
product model have been neither theoretically rich nor empirically 
robust-^ -thev . hav_e _1 ed to recommendations and applications in 
educational settings ( Gage ....... 1 978^ . If the cognitive mediational 

model is to s.upplant the process-produc t model* it must 
demonstrate this same utility. 

The next three chapters of th is report document several 
experiments concerning students* cognitive mediation of 
Instruction* All took place in schools, although the first two. 
studies are described more accurately as laboratory studies, since 

83 



they employed videotape analogs of teachfng. The third set of 
studies was a less controlled but more ecologically valid test of 
the cognitive mediational model, and took place in five elementary 
school classrooms over a three^month period* 
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~ , CHAPTER 3 * . , t 

Training Students to Use 5 trategi e * Responses 
Co Videotape Analogs of Classroom Teach ing * 



^ lOTRODUGTION 
Many models of instruction ass ume that learners are 
eognitivel y active and strategically purposeful as they attempt, ta 
learn from teaching,, " Following on this assumption, one of the 
teacher's aims in classrooms becomes that of shaping or channeling 

if 

these cognitive processes in ways that facilitate students 1 

ach ieveraent - For exajnple, a, .teacher who asks a compare^ahd- 

contrast question probably* intends students to link two correepts^ 

according to\ the attributes they share , and to rehearse the link 3 

between attributes of- the concepts as they mentally answer the 

question** It is believed that these cognitive operations help 

students to store these concepts in memory in a form appropriate 

for achieving one of the teacher's educational objectives, 

Characterizing learning from teaching in this fashion 

suggests that there are .two varieties of stimuli in instruction to 

which learners can respond cogni'tively* One variety constitutes 

thte content to be learned, what is traditionally labeled the 

acfademie curriculum* The second variety are stim^Li that teachers 

(and other media for presenting curriculum material) use' to cue 
* 

learners to use particular cognitive strategies in order to 
accomplish learning. These are instructional stimuli., To 'profit 
from rnstrtjc tional stimuli presented by a teacher, learners must 
accomplish three cognitive tasks. First, they must perceive 
instructional stimuli, i.e., notice their occurrence and 
understand the cognitive operations or strategies the teacher 
intends them to engage to facilitate learning. Second, students 
must carry out the cognitive activities to create or manipulate 
information that should* be stored in memory as a representation of 
the curriculum to be learned. Finally, they must encode this 
instruc tionaVly prepared content for later retrieval, e.g., on a 



This analysis ,of tasks students must pursue to learn from 
, * 
instruction identifies two' points where instructional effects may 

be attenuated. First* if instructional stimul i are nat perceived, 

they can not affect learning*'" Second* if instructional stimuli 

are perceived, but the learner does not carry out the cognitive 

strategies they cue, intended instructional effects are less 

likely to appear. Only when learners percefve and carry out the 

intentions behind instructional stimuli, i , e * t when the 

instructional stimulus functidns to control the cognitive 

processing of content as intended by * the teacher , can the" 

conditions influencing of students 1 learning be inferred 

unambiguously (tee Winne & Marx, f)"979, 1980). This often 

uncontrol 1 eef variance in learners 1 actual use ^f instructional 

stimuli can*aecount for some weaknesses of validity jn current 

instructional theories <Winne f 1982a^ s " *| 

Several studies (e,g, f Bassett & Ribler, 1 975 * . Pansereati et 

al., 1979; Wi.nne , 1982b) have showed that students trained to 

accomplish some or all three aforementioned cognitive tasks 

learned more than untrained students* This 's<udy tested, whether 

elementary school students could be trained ^to perceive and to act 

? " - ■ » 

on instructional stimuli common in recitation lessons; and whether 

these cognitive operations would facilitate learning. a 

The study proceeded in three phases. During the first phase $ 

a random half of the students from two cl assrooms t eacn one in av 

separate school-, were given ipstructi'on in i denti f yi ng two 

different instructional stimuli presented in specially produced 

videotaped 'lessons , and in responding differently to teach cue wi th 

a procedure that integrated cognitive and written components . As 

will be described ^ore fully later,, the written, components* 

corresponding to features of intended cognitive responses that " 

students recorded on specially prepared worksheets provided 

evidence about the degree to which they*, carried out cognitive 

featur s of the, complete instructional responses , Then, in phase 

twOj all the students in each of the classrooms viewed one 

videotaped lesson on-the same topic as they -had experienced during 

the training phase, and took multiple-choice and essay tests on 




* * 5 i 
the information in that lesson* Tn the third phase, all the 

Students in each classroom viewed six lessons about a new topic 

over a two-week period and were administered multiple-choice and 

achievement tests after the sixth lesson and again two weeks •* 

later, . * 

f - 
METHOD 

P a r t i ei p a n t,s > p _ * v ^ 

Twenty- four 7th-grade student^ from one class in one school 
and 25 7th-grade students from one class in a second school' were 
volunteers. Both schools serve middle-class neighborhoods in one 
of. the same school districtSTas Study X. Within each class, 
students^ were randomly assigned to a training group (n - 12 and ,n 
= 13) or a comparison group (n ■ 12 and n ■ 12) uii ! "r the 
constraint th^t groups were approximately balancei ^y sex. 1 
Ha teriaJLs 

Two curriculum units wefe created, one on the study of sleep 
and one about applied psychology (see Appendix A), 

The sleep curriculum was used in phases one and two of the 
study* The psychology, curriculum was used in phase three. A unit 
consisted of 12 segments, each of which presented two concepts* 
Each concept' was defined by two attributes, One defining 
attribute was common to both concepts in a segment, * Each concept 
also 'had a second attribute which was unique to that concept* For 
example, the segment on circadi&n rhythms in the sleep curriculum 
" defined CD the concept of bodily rhythms as (a) relating to 
systems of the body, and (h) having eye leg about 24 hours long I 
and (2) the concept of psychological rhythms as (a) relating to 
people's behavior and (b) having cycles about 24 hours long. 

Accompanying each segment, a text overview gave the title of 
" the segment plus a short descriptive paragraph about the 

information* to be presented. This paragraph introduced the label 
for each concept presented in the segment. Also, all^ students 
received a worksheet for each segment* It presented the title of 
the -segment and for eacK of the two concepts in the segment : the 
concept label! the two defining attributes? and two short examples 
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of /the concept, each of which contained representee 1 ops of the two 
defining attributes, - , 

* „" Videotapes were pror s F h 'our students were Caught 

about e^ch segment, T^* u*^V un* rtpted fas in niark, -nage; 
Marx Teterkon, Rtayrc*** * i q .to Ho a commotv reel tatf on 

* ■ . n 

lesson Involving a V -t. jverv w, t icher and student 
presentation of two 0*5 F , -r>nc me, teacher quest 1 ons and 

elaborative feedback ; e^ar ' t i> F t"H^' g' answers, and a summary 
(see Appendix B> . Thr in^tfuc l fn ^.a1 stimuli wore embedded 
within, the teaching p* : »i nt . Two of these were intended 

to he functionally <ii ^ oes for learners to engage in a set 
of -cognitive and wr.,ce per Anions we labeled the consolidating 
response (described urv -ainirig). The- third instructional 

stimulus cued |tudent^ to r .gage a set of cognitive and behavioral 
activities labeled the torapare-and'-contrast response fal so 
described under Training), 

Training^ ■ ^ 

Overview, Students assigned to the treatment , group were 
trained tb perceive instructional stimuli that signaled them to 
carry out cognitive and behavioral operations. The instructional 
stimulus that cued consoli dating responses to instruction was a 
teacher statement or question concerning students* mastery of the 
defining attributes of a concept such as, "Make sure you 
understand the key features of bodily cJrcadian rhythms" or "Ts 
that really clear now?** The complete instructional response to 
this instructional stimulus consisted of both cognitive and 
written operations: fl V mentally rehearsing each defining 
attribute two times, (2) reading and analyzing the first example 
on the worksheet to locate representations of each defining 
attribute* (3) .circling the words in the example that represented 
each attribute, and (4) drawing a line to connect the circled m 
material with its corresponding defining attribute* Two 
consolidating responses were cued per segment, one for each of the 
two " concepts . 

These same students also were trained to make compa r e^ and- 
contrast responses* to an instructional stimulus that, directed them 
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to consider the shared attribute and the unique attributes of the 
two concepts in each segment. An .example of this instructional 
stimulus is the question, lr Do you see how bodily rhythms and 
psychological rhythms are the same and different?" The cognitive 
and behavioral components students were to engage as a response to 
this instructional stimulus involved a sequence of four tasklf 
(l) attempt to "retrieve f rom^jnemory the defining attributes of 
each concept, or find them orf thf worksheet 4 if this failsf (2) 
mentally *idinti fy whitfh attribute is shared by the "two concepts 
and which are unique to a them; (3) place an M o" on the worksheet 
" beside the attribute shared by both concepts and an "k" beside the 
attributes unique to each concept % and (4) mentally create an 
answer to the eompare^and-contrast question implied or stated in 
the instructional stimulus. 

Training group . k random half of students in each cTassroom 
were trained to identify instructional stimuli during the H 
videotape presentation of a segment and to carry out the cognitive 
and behavioral operations constituting instructional responses to 
these cues> Training occurred in five 32-41 minute sessions (M 3 
37 minutes) distributed evenly over two weeks, The first! ten 
segments of the 12-segment sleep curriculum were used for 
training* The general procedure for training, which took plice in 
one group per classroom, was as follows, 

First, as the videotape was played, * the " trainer identified 
the first occurence of an instructional stimulus. The tape was 
stopped and the components of the instructional response were 
described and demons tra ted Fol lowing^ this , a test 4 item was 
presented and the trainer described how the instructional response 
consisted of applying the same cognitive operations to the similar 
content in order to answer the test item* Consolidating responses 
were related to mul ti pie-choice items that required students to 
analyze an example of a concept as they had to do on the 
worksheet. Oompare=and=contrast responses were related to essay 
items asking students to produce an answer describing similarities 
and differences between the two concepts in a segment, 

Next, students watched the videotape and were cued by the 
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-trainer when the instruc tional stimulus was delivered. The 
students then attempted the instructional response. The trainer 
provided corrective feedback on this attempt after students 
answered' a test question about the content^ }ust manipulated 
according to the cognit ive-plus-behavi ora I response strategy. 
Then the test item was reviewed and the trainer reiterated how it 
could be answered by using the cognitive Components of the 
instructional response associated with the instructional stimulus 

Simi lar ^practice and feedback continued for the remaining 
segments. Consolidating responses were introduced on the first 
day of training and practiced thereafter, Corapare^and^contrast 
responses were introduced on the tnird day of training and 
practiced on that day and the fourth day. The following sections 
provide a detailed description of each training session delivered 
,to the two training groups by a sin^Je trainer. Appendix C 
presents the scripts used by the trainer to deliver each, training 
session.' ^ . 

The objectives for the first training session were tot (1) m 
itrain students to discriminate the instructional stimulus for 
consolidate instructional responses (e.g., "Make sure you 
understand about hypersomnia * ") % (2) introduce and trairT^sfeudents 
to carry out the intended cognitive components for consolidating 
information; (3) train students to provide observable written 
indicators corresponding to their cognitive ac tivi ties? and (4) 
motivate students to carry out both the cognitive and behavioral 
operations by showing them the link between these activities and 
mul tiple-choice items that they would take on later achievement 
tests. 

The session began with a general introduction to the 
experiment and a description of the procedures that would he 
followed over the remaining sessions of training. Specifically* 
students were told that videotaped lessons would be shown to them 
and that the trainer would instruct them in ways to think and tak 
notes that would promote learning the information taught in the 
lessons. They were informed that they would have opportunities t 
practice a thinking strategy, and that they would answer test 
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items daring training that were based on the information presented 
in the videotape* They also were told that they would see two 
short "lessons" (i*e,, seRements), per day on the videotape, and 
were strongly encouraged to imagine that they were in the 
classroom in which the videotape had been made, 

Following this introduction* the students read the overview 
of the first segment on sleep. At this time, they also were 
reminded that when thev finished the reading, they should imagine 
that they were in the classroom displayed on the videotape; they 
would watch next, At a point in the videotape when the teacher 
.^said f lf So is it clear what I mean by bodily rhythms?", the trainer 
stopped the videotape, and pointed out the instructional stimulus 
to students.. He described that it was a signal the teacher was 
giving to tell students to think in a special way. The trainer 
then referred the students tq the worksheet corresponding to the 
concept referenced by the teacher's instructional stimulus. The 
cognitive components of the consolidate response were then 
described to them, and the trainer modelled for the students how 
and what they should be thinking by talking aloud through the 
procedure- The trainer then described .the behavioral indicator of 
this cognitive strategy by referring students to another worksheet 
on which ona half of the written response had been drawn in for 
students* (i.e. , circling the words in the example that represented 
one of the concept's defining attributes, and connecting that 
circle with the attribute printed on the worksheet; see Appendix 
C). Following, this first 'introduction, the trainer reviewed the 
entire sequence of instructional stimulus, intended cognitive,, 
response, and behavioral indicator* 

For the next worksheet, corresponding to the second concept, 
this same procedure was followed except that students were 
required to answer a multiple-choice test item immediately after 
the videotape had been stopped and before the trainer discussed 
the intended cognitive response and the written indicators of 
cognitive operations to be recorded on the worksheet. As the 
worksheet was discussed , the^ trainer pointed out the parallels 

between the cognitive operations students were to carry out during 
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teaching and eh* thinking they needed to do to answer the* * * 
muj ti ple-c^oice question they "had lust taken. Following this 
description^ the trainer told lAtudents to turn to the mul t l pi e- 
chol ce I t^n pnd descri bed f or them exact! y how the intended 
cognitive response helped them answer this kind of question* . 
These descriptions were intended to provide an incentive for 
students to, use the cognitive response during teaching. The 
answer to the mul ti pi e=choice question was then provided to 
students m 

Tn the second lesson feorrespondi n|> to the second segment of 
the sleep curriculum) presented on this first day of training, 
students were given an opportunity to practice the intended 
cognitive response and written indicators, This was followed by 
feedback from the trainer concerning the correctness of what 
students had circled in the examples, they analyzed on the 
worksheet 9 and further description about how using the intended 
cognitive response would help students answer the test item 
correctly* ^ 

The second training session began with an overview of the 
consolidate intended cognitive response and behavioral indicators 
that had been trained in "the first session^ Students were 
reminded that doing these activi tl es would help them* answer 
multiple-choice test items like those thov had experienced in the 
preceding session. They were further reminded to try to imagine 
that they were "right in the classroom" they were seeing on the 
videotape* As well, 'the trainer reminded them specifically of the 
kinds of instructional stimuli the teacher on the videotape used 
to signal them to engage in the cognitive and behavioral 
operations described earlier* 

Following this introduction, the training session followed 
essentially the same routine as the preceding one except that the 
videotape was not interrupted when the instructional stimulus was 
delivered. This required the" students to respond vttfli'n a shorter 
time span, as they would have to do in all subsequent training 
sessions and in later phases of the study, Tn this session, none 
of the worksheets that students used had been marked previously to 
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illustrate Che behavioral indicators for the/ consolidate intended 
cognitive response* 

The trainer began- the third training session by reviewing the 
entire sequence of instructional stimulus, intended cognitive 
response and behavioral indicator ?i plus the relevance off the* 
intended cognitive response for correctly answering multiple^ 
choice quiz items* 

Following this introduction, the videotape was played, and 

students responded to the consolidate instructional stimulus as in 

* * / 

session two. When the instructional stimulus for making a 

compare^and-contrast response appeared (e*g,* "Do you see the, 
difference between dreams you tend to remember and dreams you tend 
to forget?" ) f the trainer stopped the tape. He described what the 
instructional stimulus' was and illustrated the intended cognitive 
response by talking through the. cognitive operations the teacher 
intended students to use when he, provided this instructional 
stimulus * Students were next shown the behavioral indicator for 
this intended cognitive, response. Then the trainer had students 
turn to the next page of their booklet on which an ideal answer 
had been written for an essay question that asked students to 
compare and contrast these two concepts. The trainer explained 
-how this second intended cognitive response would be helpful in 
answering short essay questions that required students to compare 
and contrast two of the concepts presented in the lesson* After 
this introduction, students responded to the multiple-choice item 
that was associated with content referred to by the preceding , 
consolidate instructional stimulus. Then, they received feedback 
about their behavioral indicators connected with this 
instructional response and about their answers to thi multiple- 
choice test item- 
Students were then shown the next part off the videotape and 
told to practice looking for both types of instructional 
stimuli, The videotape was not interrupted for the instructional 
stimulus* i ntended cognitive response, and behavioral indicators 
associated with the consolidate strategy, It was stopped 
momentarily (approximately 30 seconds) following delivery of the 
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compare^and-conerast Instructional stimulus to^ al low students time 

to carry out the newer intended cognitive response and behavioral 

components this stimulus signaled. Foi 1 owl ng 1 thl s part of the* 

videotape, students responded to the mu3 tl pi erchoi ce item drawn 

frofr this second part of the videotape. Another eompare-and- 

i - 
contrast essay Question and its ldea3 answer were analyzed in 

terms of how the compar e-and-cont ras t intended cognitive response 

would help students answer these kinds of questions, Then -both _ 

types of behavioral indicators students had -marked on their 

worksheets for, the second part of the videotape were reviewed 

while the trainer provided feedback. Finally the answers to, the 

mul tlpl e-choice question were revi ewed as the trainer reiterated ... 

how making the consolidate intended cognitive response should help 

students answer this type of question. 

The objectives for the fourth training session were to have 
students continue to practice i dentifying, both types of 
instructional stimuli, making both types of intended cognitive 
responses, and providing the behavioral indicators associated with 
each intended cognitive response. This session began with the 
trainer reminding students to .imagine they were actually in the 
classroom they were seeing. Then, students read the overview, 
watched the videotape,' responded to the essay ? and multiple-choice 
test questions, fin that order to avoid providing Information for 
the essay answer in the multiple choice item) received feedback on 
their behavioral -indicators , and then received ^feedback about 
their answers t'o the test questions. During this last activity, * 
the trainer emphasized how Tnaki ng the intended cognitive responses 
during the lesson would* enhance students 1 performance on both 
types of test items, 

Tn the fifth and last session of training*, students were 
.given another opportunity to practice all of the skills they had 
been taught in 'the preceding sessions. Students read the 
overview, watched the vi deotape, • answered thW test questions, 
received feedback on their behavioral, indicators for the two types 
oft intended cognitive responses, and analyzed"' 'their answers to the 
tes.t questions in terms of their Intended cognitive responses. 
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The trainer again stressed chat making the intended cognitive 
responses should help them get better scores on achievement tests, 
and that students had to pav close attention to the teaching 
displayed on the videotape* 

Comparison group * A second jrai ner provided the remaining 
half of students in each class with exactly the same materials 
(videotapes , worksheets, and test items). Students in these " 
groups did not receive training to identify instructional stimuli 
in the videotaped lessons or to make instructional responses and 
the associated behavioral indicators for these cognitive 
operations L Otherwise, all other events were the same, including 
the amount of time they spent viewing the videotapes and' 
discussing the topics (range = 31 to 41 minutes, M = 33*5 
minutes). 
Ins tru me nts 

Apti tud_e_ « Two weeks hefore training, all students were 
administered a standardized vocabulary test ( Cqgni tive Abilities 
Test , Thorndike & Hagen , 1971) to gauge verbal ability,^ 

Use of intended cogni ti veresponse * Two measures of the 
effects of training were obtained two days after the last training 
session (session 5). Both were based on the remaining two 
segments of the sleep curriculum, ^ A consolidate score and a 
compare-and-contrast score were obtained by examining the way 
trained students marked their worksheets as they had been 
taught. These scores were assumed to reflect students' use of the 
intended cognitive response components of the complete 
instructional response* The basis for this assumption is as 
follows* 

For the consolidate instructional response, we reasoned that 
i . 
a student must analyse the way the attribute! of a concept are 

represented in the example provided on the worksheet in order to 

circle the words that represent those attributes. Then, in order 

to draw a line that connects this circled material to the 

statement of an attribute, the student must read the attribute to 

verify that a proper connection is being drawn, This act of 

reading is equivalent to rehearsing the attribute. 
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* The links between the cognitive and the written components of 
the c0mpare-and=cnntrast instructional response are more 
tenuous. For the student to mark Che concepts' attributes 
correctly, the attributes must be read, As before, this 
constitutes at least one rehearsal of the attributes* As well, Co 
identify the two concepts' shared attributes f a mental judgment of 
similarity must be made, ^% ^ remain i ng two cognitive components 
of the compare^and-contrast intended cognitive response are not 
clearly reflected in the behavioral indicators of this 
instructional response* Students who followed our training would 
have made a mental judgment of dissimilarity to mark the two 
concepts' unique attributes* However, an alternative to this 
intended cognitive activity is to mark the remaining attributes 
without making this judgment or even reading them, since they must 
be" the unique attributes by eliminations There is no behavioral 
indication in our data that students complied with the remaining 
cognitive component, namely, mentally framing an answer to a 
compare-and-concrast question, We can only assume that studenCs 
were motivated to carry out this activity because they were shown 
how it would transfer to the short essay test items* 

The same kinds of scores were obtained from the worksheets 
students had available for the psychology curriculum which was 
delivered over four consecutive days (Mondays-Thursday of the 
following week). The 12 curriculum segments were presented on 
videotape, partitioned into three segments per day* 

Achievement* An eight-item multiple-choice test and a two- 3 
item essay test provided scores describing students' achievement 
on these last two segments of the sleep curriculum (see Appendix 
D) * A 24-i tern multiple-choice test and a four-item essay i:est 
(Appendix D) based on the psychology curriculum were administered 
on Friday, the day after all of the students had viewed the last 
three segments of the psychology curriculum* The multiple choice 
and essay tests 1 for the psychology curriculum were readministered 
to all students two weeks later* 

For'both the sleep and psychology achievement tests, essay 
items were given first in a separate booklet and collected before 
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the multiple-choice items were given out.. As each student 
finished the essav items* he/she raised his/her hand* at which 
time the tester collected the essay exam booklets and distributed 
the mul tiple^ehoice test booklet* 

Scoring procedures * For the consolidate score , one point was 
awarded if the student encircled the part of the example 1 . Chat 
represented a concept f s attribute and drew a line connecting the 
circle to the attribute listed on the worksheet. Both the circle 
and the line Jhad to be present and unambiguous fof credit to be 
awarded. Two points were possible for each concept (one for each 
of the two attributes), four points' for each segment (two concepts 
with two attributes each), For the sleep posttest, the maximum 
consolidate score was eight because there were two segments for 
which behavioral indicator .data were available. For the 
psychology curriculum* the maximum consolidate score- was 
because there were 12 segments for which behavioral indicator data 
were collected* 

The compare-and-contras t behavioral indicator score was 
derived by awarding one poinc for indicating which of the 
attributes for the two concepts in a segment were the same, and 
one point for indicating the two attributes that were unique, In 
the latter case, the unique attributes for each of the two 
concepts had ^to be clearly indicated, Thus , there were two 

possible points for each segment, one each for indicating the 

J 

shared and the unique attributes; For the sleep curriculum, the 
maximum score was four (2 segments x 2 points) % for the psychology 
curriculum the maximum score was 24 (12 segments jc 2 points)* 

Mul tiple-choice items were scored as either correct or 
incorrect. The number of items correct served as the multiple^ 
choice test score. 

Seven different scores were recorded for each essay item. 
The first two scores for an item each had a possible value of zero 
or one. These two scores indicated whether the unique attribute 
of each of the two concepts had been retrieved correctly. The sum 
of these two scores for each i tern aggregated over the two essay 
items was cal cul ated % to produce the attributes recalled scale, 
Scores on this scale thus ranged from zero to eight. 
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The third score indicated the degree to which the similarity 
between the two concepts had been specified correctly. This score 
was zero, one* or two. One was given if the idea of a similarity 
was mentioned, and two was given for correct specification of the 
similarity. i*e. f describing the shared attribute. Zero indicated 
no recall or completely incorrect recall* 

The fourth score ranged In value from zero to three and 
referred to the correct specification of the difference between 
the two concepts. A score of one was given if the idea of a 
difference was mentioned. Another point was given for correctly 
linking each unique attribute to its concept label when 
identifying the difference between the two concepts. The sum of 
these third and fourth scores for each item aggregated over the 
two essay items was calculated , to produce the compare-and— contrast 
«ale. Scores on this scale could range from zero through twelve. 

The fifth score, having a value of ^ero or one s awarded a 
point for including an example or elaborative incidental content. 

The sixth and seventh scores reflected two types of errors. 
One type of error was an interchange of attributes across 
function* that is, referring to a similarity as a difference. The 
second type of error was an interchange of attributes across 
concepts* that is* defining one concept from a segment using the 
unique attribute of the second concept in that segment* or either 
attribute of a concept in another segment* Each of these scores 
had possible values of Eero or minus one. 

The sum of all these scores produced a total score for each 
essay that could range from Eero to eight. For the sleep 
curriculum,, aggregating all seven of the scores on the two-item 
test produced a total essay scale with a range from zero to 16, 
Total essay scores could range from zero to 32 for the four^item 
psychology essay test, (A detailed scoring manual for the essay 
tests is provided in Appendix E* ) 

RESULTS AND DISCUSSION 
For all following analyses, the original sample is reduced to 
37 (1-6 total in the trained group* 21 total in the comparison 
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group). The ]oint criteria for inclusion in the analyses was that 
students had to be present for the , achievement* tests on the sleep 
curriculum, the, four days when the psychology curriculum was 
presented^ the immediate posttests on £he psychology curriculum, 
and the delayed psychology achievement tests. 
Caveats 

It is* essential, to stress that several aspects of 

interpretations of the multiple regression analyses reported below 

must^be considered very tenuous* First, it is reasonable to" raise 

the^question of what population is supposedly represented by the 

samples we were able to work with in this proiect * Second* the 

representativeness of whatever population these samples describe 

is limited by the small sample seizes we used in order to carry out 

the very labor-intensive treatments. Third, the stability of all 

statistics based on these small samples is doubtful* Although wa, 

follow conventions about reporting probabilities of type I errors 

common in research on teaching* we strongly advise ^against placing 

v 

too much faith in "statistical sign if i cance * " Overall, we 
encourage that these analyses be taken as descriptive of the 
groups we worked with and the processes we explored rather than as 
strongly probabil is t ic basis for inferences about effects in a 
popul at i on * 

The third problem, i*e,, instability* warrants special 
mention whenever aptitude- treatment interactions are reported 
because of the extremely small numbers of eases on which separate 
regression slopes depend* In many of these^ instances , especially 
in the analyses described later for Study TV, such interactions 
probably reflect the influence of only a handful of students* We 
have reported these analyses, however, because the effects that 
were observed merit consideration in future research. 
Nonetheless, we do not claim that these results are robust* 
Replication studies need to* be undertaken to explore the results 
we present, and thereby test the speculations we offer here* 
C an Students be Trained to Make Intended Cognitive Responses? 

The worksheets students had available during the 
instructional sessions were scored to reflecf their use of the 



101 




consolidate and Che cornpare^and-contraKt responses . There would 
be no reason to expect students in the comparison group to exhibit 
written indicators on their worksheets of having made these two 
kinds of cognitive responses to the i ns L rue t i onal stimuli 
presented in the videotaped teaching- Tn fact, this was the case 
for both Che sleep and the psychology curricula. 

Students in the groups trained to use these intended 
cognitive responses and to reflect their cognitive operations on 
their worksheets generally did so (see Table 3)* For the sleep 
curriculum, trained students correctly executed, on average* seven 
of eight indicators of consol idat ing , and all' students scored 
perfectly on the compare-and^contrast behavioral indications. 
Transfer of this strategy to the psychology curriculum for trained 
students was successful, (Jfn average, they used about three out of 
a possible four behavioral indicators of consolidating per 
segment, and they were nearly perfect at providing indicators for 
the corapare-and-contrast cognitive operations. 

Another measure of transfer of training is the correlation 
between the behavioral indicator scores for Trained students 
across the curricula. This was ,44 Cp - . 03) for the consolidate 
scores, The seeTOingly low value is partly attributable to a 
restricted range of scores f rem the sleep curriculum. No 
correlation can be calculated for the compare-and^contrast scores 
because there was no variance for these scores on the sleep 
eurr i culum, 

Interestingly * the correlation between consolidate scores and 
compare-and^contrast scores for the psychology, curriculum was -,*>2 
(p - s 01). We" have no hypothesis about why this inverse relation 
appeared* 

Overall, then, these results provide evidence that students 
can be trained to make cognitive responses to instructional 
stimuli in accord with a teacher's or researcher's intentions, 
.Moreover, students also can provide observable indications of 
whether they actually use these cognitive responses during 
instruction. The short-term transfer of these skills was 
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TABLF 3 



Means , Standard Deviations, and Maximum Scores for Behavioral 

Indications of T n t ended Cognitive Res rinses for Trained Students 

Sf udy IT 



Curri cul urn 


nonsol idate 


Cora par e^and^Contrast 


SI eep 


A ,94 (8) 


4,00 f4V 


*■ 




0,00 


Psychology 




22,78 f24) 


% 


5, 20 


1.70 









1 

Note: Upper numbers are means v 1 owog numbers are standard deviations. 
Numbers 1n parentheses are maximum scores* 
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demonstrated here, but we believe that lon^term, transfer almost 
surely would rquire some kind of sustained practice coupled with 
an environment that provided incentives for students to maintain 
these responses to teaching* This need is implied by the decrease 
in trained students 1 use of these skills during the psychology 
curriculum, particularly with regard to the consolidate 
instructional response * 

How Do Inten ded Cognitive Responses Relate to Achievement? 

To gauge the relation between students* use of intended 
cognitive responses and^achievement f correlations were computed 
between behavioral indicator scores and aeh ievement scopes for 
trained students (see Table 4), No statistically reliable 
relationships were observed among the psychology behavioral, 
indicator scores and psychology achievement scores (p <^ *10), 
(Recall that correlations involving the tfleep consolidate scores 
or either psychology intended cognitive response scores -are - 
attenuated due to restricted ranges^ In sharp contrast and 
despite the ^possibility of attenuated variance* the behavioral 
ind kca tor * scores for consolidate responses in the sleep curriculum 
show moderate positive and fairly consistent relationships with 
all measures of achievement* 

This finding is baffling* Among trairfbd students, those who 
displayed more behavioral indicators (and presumably employed the 
intended cognitive response more frequently) while viewing the two 
videotaped lessons upon*which the sleep achievement tests were 
based* tended to have higher scores on all three assay scales and 
one of the three multiple-choice scaler* Yet this relationship 
did not hold for behavioral indicators completed during the 
psychology curriculum* Recall that the correlation between 
consolidate scored across the curricula was only *44* While this 
low to moderate correlation may be an artifact of attenuated 
variance, it is also possible that students' use of intended 
cognitive responses did not transfer optimally from the sleep 
curriculum to the psychology curriculum* It mav have been the 
case that the more capable learners acquired the intended 



TABLE 4 



Correlations among Behavioral Indicator Scores and 
Achievement For Trained Students 
Study IT 



Achi evemeap Measures 



Behavioral Indicators 



Sleep 



Fsychologv 



Consolidate 



Compare^ Compare^ 

and— and^ 
contrast Consolidate contrast 



Sleep 

Mul t i pi e^cho i ce 
Attri-buues recalled 
Compare^and-contrast 
Total essay 



24 
43* 
30* 
36 



Psychology 

Mu 1 1 i pi e— ch o i ce 
Attributes recalled 
CoTOpare^and^cont ra st 
TotaV essay 



57* 
52* 
57* 
59* 



35 
30 
13 
20 



OS 
00 
16 
10 



Delayed Psychology 
Mul tip! e— choi ce 
Attributes recalled 
Compare^and-contrast 
Total essay 



20 
60* 
57* 
60* 



-14 
22 
10 
12 



16 
21 

33 
25 



Note t No correlations can be calculated involving Sleep compare-and^ 
contrast indicator scores because of zero variance on this 
measure. Decimals have been omit ted on correlations. 



* p < ,05, two- tailed 
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cognitive response during training and then failed Co use it, or 
perhaps failed to record behavioral indicators of their cognitive 
responses to instructional stimuli during tho psychology 
curriculum. However* without data rp^nrriine individual 
differences 'in aptitude that describes attention to instructional 
stimuli and perception of intended cognitive responses, this 
interpretation remains speculative, 

Do Intended Cognitive ' Responses Enhance Learning from Instruction? 

To test the relative influence on achievement of training 
students to make intended cognitive responses, comparisons were 
made to the group of untrained studencs, 

A backward selection mul ci pi e-regressi on procedure 1 was used 
to make this comparison, The backward selection procedure begins 
by entering all possible predictors in the regression equation as 
one set, and Chen removes predicCors individually if they fail Co 
meec a predefined criterion. The criterion used here was that 
residualized predictors were removed from the multiple regression 
equation if Che ^statistic testing the proportion of variance 
accounted for by a predictor had a type T error exceeding -10, 
Thus, this regression analysis retains only residualized 
predictors that account for a statistically reliable (at p ,10) 
portion of variance in Che dependent variable. Moreover, this 
procedure has the property that, following the elimination of all 
statistically unreliable predictors, Che remaining predictors are 
mutually residual i^ed for one another, thereby making them 



1 Throughout this report, we will refer to predicCors that remain 
in regression equations by the name given them in their respective 
sections chat describe th^ methods for each experiment, We adopt 
this practice for simplicity of expression. It must be remembered 
Chat the correspondence is not perfect between the operational 
definitions of variables that yield raw data and the statistically 
defined residual variables contained in a regression equation (see 
Winne, 1983c). In other words, the construct which we imply by 
using a label for a variable's operational definition is not 
isomorphic to the construct reflected by a variable's label after 
the raw data are residualized in the process of doing a multiple 
regression analysis, Resources and practical constraints 
prohibited us from following procedures Winne recommended that 
might have lessened Che potential difficulties entailed by this 
lack of correspondence, 
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orthogonal. To express the extent to which each resi dualized 
predictor accounts for variance in the dependent variable, we 
report" squared part (or semipartial ) correlations. These are 
correlations between the predictor a , as residualized in the context 
of other predictoi*s remaining in the regression equation at the 
point where no other predictors can be removed according to the 
statistical criterion (p. <■ 10), with raw scores on the dependent 
variable * 

Three major categories of predictors were entered at the 
first step in the backward selection regression analyses, One was 
a measure of the students 1 verbal ability* their vocabulary score 
deviated about the g-rand mean, The second category of predictors 
consisted of two effects-coded vectors. One compared the trained 
and comparison groups, and the other contrasted the two classrooms 
from the two schools in this study. For the comparison of 
experimental groups, the group that received training was coded +1 
and the comparison group was coded -1, The contrasts between 
schools cannot be given any particular meaning because we do not 
have sufficient information regarding the qualities that 
differentiate them. However, such variance can represent 
educationally important effects on learning* Also, leaving 
variance due to schools in the residual mean square would reduce 
statistical power and confound reliable variance with error 
variance, Thus, the contrast between schools was included to 
redude the residual mean square in the regression analyses, 
thereby increasing statistical power for the tests contrasting the 
training and comparison groups, A third category of predictors 
were aptitude^group interaction terms created by multiplying the 
vector representing vocabulary and the effects-coded vectors. 

Twelve separate analyses were done* one corresponding to each 
of four types of achievement (raulciple^ehoice, attributes recalled 
in the essay items, eompare^and^eontrast statements in the essay 
items, and total essay score) for the sleep curriculum f the 
immediate posttests on the psychology curriculum, and the delayed 
psychology tests . 
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Descriptive statistics are displayed in Table 5, The resul cs 
of the regression analyses and effect sizes for differences 
between groups (difference between ad Tusked means divided by the 
square root of the residual mean* square from the regression 
analysis) are presented in Table 6", Croup differences are 
reported if they describe effects. that would he statistically 
reliable at least ten times :p&r hundred comparisons (p < .10). 
More than traditional allowance for type T error was adopted here 
for exploratory purposes and to increase statistical power* 

Training students to make cognitive responses we intended 
them to make during instruction had some benefits, particularly on 
the essay tests for the _ _s\eep curriculum, hut there clearly were 
no large and consistently positive effects. The effect size 
statistics indicate that an average student from the comparison 
group (at the 50th percentile) who received training would have 
increased scores t relative to the comparison group distribution, ' 
on the sleep attributes recalled scale to the 68th percent Me, on 
the sleep compare and contrast scale to the 70th percentile; and 
on the psychology multiple-choice test to the 60th percentile, No 
reliable apt it ude- treatment interactions were observed. While 
there are several statistically reliable differences between 
schools and apt i tude-school interactions, these do not lend 
themselves to any useful interpretation as explained earlier. 

It is reasonable to question whether students who 
participated in training to make intenden cognitive responses but 
who failed to manifest these behaviorally while studying the 
psycho -Logy curriculum should be distinguished from those who 
participated and evidenced consistent use of these cognitions (as 
indicated by the behavioral indicator scores)* The general 
absence of statistically reliable relations between behavioral 
indicator scores and achievement scores (see Table 4) suggests 
that selecting students for their performance levels on behavioral 
indicators of intended cognitive responses would not alter the 
direction of the preceding findings, Tn addition, the behavioral 
indicator scores on the sleep curriculum clearly show that all the 
students had mastered the cognitive operations they had" been 
taught, 
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A number of possible interpretations of these results can be 
offered. One interpretation focuses on the effects of the 
perceptual components of the training, assuming there was little 
impact on the cognitive strategy component. Training students to 
perceive the intended cognitive responses associated with 
instructional stimuli has little transferable impact on students 1 
learning. Thus, it could be claimed that the perceptual training 
to attend to instructional stimuli increased the salience of 
content taught during the sleep curriculum, setting the stage for 
trained students to use whatever cognitive strategies they had 
developed prior to training on content that was easier to Identify 
as important* As a result , the students developed more elaborate 
networks in long term memory for the sleep content* This aided 
them in the Relatively free recall retrieval task of the essay 
test. But for the recognition "task on the multiple choice test, 
the more elaborate semantic networks of the trained students did 
not provide them with an advantage vis a vis the comparison 
group* Tli is difference in performance in free recall versus 
recognition tasks has been documented numerous times in research 
on long term memory (Anderson, 1980), 

A similar explanation of the results can ho gi v^n ' focusing on 
the cognitive strategy training* It is possible that the 
perceptual training was inconsequential, but that the cognitive 
strategy training was successful* Thus, in learning the content 
taught in the final two sleep segments, the trained students 
employed the cognitive strategies that we had taught them, leading 
to more elaborate semantic networks, However, if perceptual 
training was inconsequential, the cognitive strategy may have been 
used at times throughout the lessons that were not oued 
specifically by the instructional stimuli. From here the 
explanation parallels the previous one, namely, that trapped 
students developed relatively more, elaborate networks^! 
information but did so under their own guidance rather than taking 
cues from instructional sfcimul i, 

Neither of these explanations adequately deals with the lack 
of transfer of scores for the behavioral indicators observed 
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during presentation of the psychology curriculum. Again, however, 
the lack of correspondence between the frequency of use of the 
cognitive strategy and achievement in psychology is puzzling* One 
explanation is that the use of the cognitive strategy with the 
psychology curriculum was not helpful. But if so ? why were there 
positive and statistically reliable correlations between 
behavioral indicator scores and achievement on the tests for the 
sleep curriculum when the structure of these two curricula was t]3e 
same? It may be that different students used the behavioral 
indicators more frequently on the two curricula as suggested by 
the correlation between the two behavioral indicator scores 
fr=,44). Some individual differences construct other than verbal 
ability may account for these results* We have found in another 
study (Marx, Winne* & Howard f 1982), however, that at least the 
cognitive style constructs of field dependence— independence and 
locus-of -control appear to be unrelated to children's ability to 
perceive and execute a teacher's intentions for students' 
cognitive processing. These two constructs, then, could be 
eliminated as candidates, 

CONCLUSIONS 

Further consideration of these results will be taken up 
following .the results of the next study which paralleled many 
features of this one* 
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CHAPTER 4 

Further Questions about Students' Responses to 
Teaching in Varying Analog Settings: Study, til 
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CHAPTER 4 



Further Questions about Students 1 Responses to 
Teaching in Analog Settings 

INTRODUCTION 

The results of Study TI indicate that elementary school 
students can be taught to use cognitive strategies for classroom 
learning* This interpretation rests on the assumption that the 
behavioral indicators represent valid traces of the cognitive 
operations students were taught to apply to information provided 
on worksheets* For the purposes of Study III* as in Study IT, we 
choose to interpret the data about behavioral Indicators in this 
manner* If one accepts th^s assumption, what remains to be 
explored is the impact of using this cognitive strategy on 

subsequent achievement* 

In an earlier ; study (Winne & Marx, I960)* we found that 
university students could easily learn a mul ti^component cognitive 
strategy to use in response to instructional stimuli delivered in 
lectures. But* when students returned to an, ecologically valid 
learning environment (the lecture hall) where the outcome of their 
learning was important to them ( namely* their final grades in an 
undergraduate course)* manv students chose not to use the strategy 
they had been trained to use. but to revert to their own 
idiosyncratic cognitive responses to teaching that they had used 
before we trained them in ours* In addition, use of the strategy 
after only one hour of training had a detrimental effect on 
learning compared with control groups, 

In that study, we speculated that* for many students who 

tried, to use the strategy we had trained, working memory capacity 

was strained by the requirement that they retrieve* sequence* and 

execute the components of a new cognitive strategy while they were 

* * * . 

simultaneously attempting to attend to informatidn being delivered 
at a rapid pace in the lecture* What these students told us in 
conversations following formal data collection was that ? although 
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they saw much merit in Ch<» cognitive st^at^gie^ had trained 
them to use, they were not proficient enough at carrying out thsse 
strategies to record in their notes a 1 ! the content that was being 
presented in the lecture, 

There probably were two interlocking reasons for this 
difficulty: The first is that we did not provide the students in 
our 1980 study with nearly enough opportunity to practice the new 
cognitive strategies they were to engage following the delivery of 
instructional stimuli during lectures* This flaw in our 
procedures resulted in low levels or perhaps even no automatic i cv 
in the students* ability to execute the intended cognitive 
responses which they had learned in training* Thus, the cognitive 
strategies we trained quite likely were not applied to concents as 
thoroughly and expertly as we intended* In turn, the hypothesized 
gains in achievement relative to a control group would fail to 
appear under these conditions because the strategy was not used 
properly* 

The second reason that our 1980 study may have failed to 
yield the findings we expected may relate to students* ability to 
pay attention to the lecture* Attention is a limited cognitive 
resource (e,g*, see Calfee, 1981; Anderson, 1980) 'that can be 
channeled to external information, such as concepts h . ir,g 
presented in a lecture, and to internal cognitive act ^ ■ ,?s , such 
as retrieving and sequencing procedures for learning concepts 
being presented in a lecture* When attention is focused primarily 
on external information* there will be little of this resource 
that remains available to monitor internal cognitive activities if 
the information being presented externally is complicated, 
unfamiliar* or fast paced* Alternatively* if internal cognitive 
activities are not automatic, and therefore demand considerable 
attention to carry out, not much of one's attentiona! resources 
will be available to devote to perceiving information emanating 
from external sources* The external information that is, not 
attended to could be curricular, instructional stimul i or both, 
Under these conditions of low automatic i tv* then, the poor showing 
of trained students on achievement tests are potentially 
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attributable to both less curricular information being perceived 
and less i nscruc tionall v appropriate cognitive grocejsing of the 
curricular information that is perceived due to students 1 
inattention to instructional stimuli, 

In designing the training procedures for Study II f we sought 
to insure that students would achieve automatieity in executing 
the consolidating and the cempare-and-eontrast intended cognitive 
responses. The behavioral indicator scores for the iimediate test 
of training on the last two segments of the sleep curriculum 
showed that we were reasonably siaceessful in this respect ,^ perhaps 
attributable to any or all of^ (1) sufficient length of training 
(5 sessions), (2) practice and feedback about executing the 
intended cognitive responses, (3) incentive for learning the 
intended cognitive responses because of their close association 
with cognitive activities involved in answering test questions , 
and (4) training using a format and medium that matched that which 
students would experience in the tests of how training influenced 
achievement (i*e, f worksheets and videotaped teaching)* Thus, 
Study TT demonstrated that students could be trained to use a new 
cognitive strategy when cued by instructional stimuli. These 
talents, however, were not as robust as we had expected with 
respect to their transfer to a longer curriculum, nor were they as 
important in influencing achievement scores as hypothesised, 

A long history of research supports the necessity of the 
first and second features, namely, sufficient exposure including 
practice plus feedback, in training programs designed to promote 
expertise in tasks somewhat like those we taught in Study II 
(e.g. , see Brown, 1978), We judged on logical grounds that the 
third feature of the training program, relating to providing an 
incentive for using the cognitive response strategies, could not 
be a factor limitine the robustness and relevance to achievement 
of intended cognitive responses like those we trained, Thus, by 
elimination, we sought to explore the fourth feature of the 
training environment as a source for the absence of effects 
predicted in Study II. Our strategy was' to decompose the 
videotape and worksheet components of the training to test the 
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videotape and worksheet components of the training to test the 
hypothesis that they might interact with one another in n manner 
that somehow interfered with transfer of the cognitive strategies 
or inhibited their positive influence on 1 earning. 

This was aocompl i shed hy creating n ror.'il of thr^i 5 treatment 
groups and two comparison groups, The three treatment groups all 
Involved training of the cognitive strategies, one with onlv the 
videotapes , one with only the worksheets, and one with both the 
v ideo tapes and worksheets * Th i s last group was the same as the 
treatment group in Study IT, In the two comparison ^groups the 
students were exposed to either the videotape only or videotape- 
plus-worksheets, but they were not taught to use a particular 
cognitive strategy* The Videotape^plus^worksheet comparison group 
included the same activities as the comparison group in Study 
II* A comparison group that only read the. worksheets was not 
included since this would involve only minimal instruction and 
would have reduced group sines to extremely low numbers, 

METHOD 

Par tic ipants 

A total of 70 seventh-grade students from three classrooms in 
one school were volunteers in this studv* T he school serves a 
lower middle^class neighborhood in the same school district as 
that which participated in Study TI* Students from each of the 
three classrooms were pooled to form a single population and then 
randomly assigned co one of three treatment or two comparison 
groups under the constraint that groups were approximately 
balanced by sex and for their representation from each of the 
three original classrooms* 
Materials 

The same curriculum units, worksheets, videotaped lessons, 
and tests used in Study IT were used here (see Appendices A-E) * 
Training 

Three of the five groups in this study received training to 
make intended cognitive" responses , One of these groups, hereafter 
referred to as the workshee t-pl us-vi deotape training group, 
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received exact Iv the same training as the group trained in Study 
II, All the procedures described earlier were identical to those 
used in the current study* 

The second training group, called the videotape^only training 
groups received the same training as described in the preceding 
experiment except that students were not provided worksheets on 
which to record behavioral indications of their cognitive 
responses to instructional stimuli that were presented during 
teaching. In order to teach the students in this group how to 
make the cognitive responses* overhead transparencies made from 
the sasa worksheets that were being used hv students in worksheet^ 
plus^videotape training group were shown, ' When the teacher on the 
videotape provided an instructional stimulus, the trainer 
simultaneously turned off the videotape and turned on the overhead 
pro lector* Thus, students fn the vi deotape— on! y condition saw on 
the projection screen the worksheet that students in the 
Worksheet^plus— videotape group were using at their desks* 

During the sessions in which students in the videotape^only 
group were being trained to make intended cognitive responses , the 
trainer used a pen to mark the transparency in the same manner as 
the behavioral indicators that were being taught to the students 
in the worksheet-plus-videotape group* In other words, the 
videotape-only training group received exactly the same 
instruction as did the worksheet-plus=videotape training group 
except that students in the videotape^only training group could 
not mark up worksheets, Instead, they were trained to carry out 
the mental equivalent of the behavioral indicators while looking 
at the projection of the worksheet, As the training sessions 
progressed, the trainer stopped turning off the videotape so that 
students in the videotape^only group were required to carry out 
their tasks in the s same time available to students in the 
v Ideotape-plus-worksheet group. In this group, then, students did 
everything that those in the worksheet^plus^videotape group did 
except write out behavioral indicators for intended cognitive 
responses* Otherwise* all aspects of the training in this group 
(e,g,, answering test items, receiving feedback) were the same as 
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those for Che videoEape-plus-workshee t group* 

The Chird group to receive training in this studv did not 
view the videotapes of the lessons* They only were provided the 
same worksheets that were handed out n the worksheet^pl us— 
videotape trailing group and were instructed In the intended 
cognitive response and behavioral indicators. Thus, this group 
received no instruction to identify instructional stimuli as- cues 
about when to apply the intended cognitive response during 
lessons* In all other respects, this group was the same as the 
video tape^plus^worksheet group* 

There were two groups used for comparison in this study, The 
first of these, labelled the videotape^only comparison group, 
merely watched the videotapes of the lessons* answered the test 
questions, and received feedback about their answers, They 
received no worksheets, nor were they given any instruction 
whatsoever about instructional stimuli, intended cognitive 
responses, or behavioral indicators, The second comparison group, 
called the vi deotape^plus^worksheet comparison group, were handed 
the same worksheets as described previous! v to accompany the 
videotaped lessons in which they were participating* However, no 
reference was made to instructional stimuli, intended cognitive 
responses, or behavioral indicators during the sessions- As well, 
none of the worksheets provided illustrative behavioral indicators 
of intended cognitive responses that were seen in the videotape^ 
plus^worksheet condition, The videotape^plus^worksheet comparison 
group thus received exactly the same experience as the comparison 
group in Study II. 

The range of times for training sessions and the wean time 
each group spent in sessions covering the first five sets of 
double segments about sleep or viewing the videotapes are 
presented in Table 7* 



In the analyses reported in the following sections, the 
original sample of 70 students is reduced to 44* The loint 
criteria used to select students who would he included in the 
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TABLE 7 

Time Spent by Groups 
Study TIT 

Group Range (min.) Mean (invru ) 

Trai ni ng 

Worksheet -pi us-vi dec tape 
. Vi deotape=on 1 v 

Works he e t— on 1 v 



36- 41 

37- 40 
39-46 



39 
39 
41 



Compar i son 

Vi Heo t ape-on 1 y 

Vi deoCape-p lus-work sheet 



17-29 



21 

36 



analyses were the same as chose for Study It with the added 
requirement that students who were rereivin^ training to carry out 
intended cognitive responses had to be present for at least four 
of the training sessions* The analyses for this experiment 
parallel those for Study 11, 

Can Students Be Trained to Make Intended Cogni tj ye Responses? 

The worksheets used by students in the worksheet^only and 
wo rkshee t-*plus*videot ape groups were scored for students 1 use of 
Che consolidate and the compare-and^contrast responses* (Recall 
that the third group to receive training, videotape-only, did not 
use worksheets, hence they are excluded from all analyses of data 
regarding behavioral indicators of intended cognitive 
responses.) As was the case in Study IT, students in the 
comparison groups who received worksheets were not expected to 
mark 'them in accordance with the behavioral indicators we defined, 
and this was the case, 

The behavioral indicator scores for students in the two 
trained groups are displayed in Table 8* With respect to the 
written indicators of the consolidate intended cognitive response 
on the sleep curriculum, students in the worksheet^only group 
executed an average of more than seven out of eight components of 
Che behavioral indicator* Students in the worksheet^plus— 
videotape group, while performing at a slightly lower level, 
nonetheless provided approximately 75% of the behavioral 
indicators of the consolidate intended cognitive response* In 
comparison to Study II, the lower mean for the worksheet-plus^ 
videotape group is attributable to two students , one of whom 
scored only one (of 8) on this measure and another of whom scored 
only two* Overall, both groups performed well in providing the 
behavioral indicators for the compare^and-contrast intended 
cognitive response* 

On the psychology curriculum, the worksheet^onl y training 
.group performed to about the same level as did the worksheets-plus^ 
videotape group in Study II on the consolidate behavioral 
indication score. The Study III 'worksheet-plus^vi deotape training 
group performed noticably less well than its counterpart in Study 
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IT ¥ although the lower mean can be attributed primarily to one 
student in this group who never provided behavioral indicators. 
If this student is eliminated, the mean for consolidate scores 
rises to 10.44. Both training groups per formed' equa 1 1 y well in 
providing the behavioral indicators for the compare-and=contrast 
intended cognitive response on the psychology curriculum* 

Correlating the scores for behavioral indicators recorded 
during lessons on the sleep curriculum with those obtained during 
lessons on the psychology curriculum gauges the extent T of transfer 
of the use of the cognitive strategies a^oss the curricula. For 
the worksheet-only training group, the correlation for consolidate 



scores was -.05. The correlation for the compare-and-contrast 
scores cannot be calculated because of this group's zero variance 
for this score during the lessons on sleep* For the worksheet- 
plus-videotape training group* the correlation across curricula 
for the consolidate behavioral indicator scores was * 80 (p - ,01) 
and for the compare-and-contrast behavioral indicator scores the 
correlation was .67 (p - .02). 

Unlike the earlier study, correlations between the _ 
consolidate and the compare-and-contrast behavioral indicator 
scores in the psychology curriculum were not negative. For the 
worksheet-only training group, this correlation was * 58 Cp - 
,08), For the workshee t=ptus-vi deotape training group, this 



With the possible exception of a single student or two who 
failed to provide behavioral indications of i n tended" congi tive 
responses, these data show that students can he trained to carry 
out intended cognitive responses triggered by instructional 
stimuli. Moreover, the extent to which these students executed 
these behavioral indicators during the two curricula shows that 
students who were trained to make intended cognitive responses can 
carry them out during instruction. Transfer across the two 
curricula was very strong for the worksheet^pl us^vi deotape 
„ training group, but near Eero for the worksheet- onl y training 
group. We have neither data nor a theoretical argument co help us 
interpret this difference. 



correlation was" ,■22 ( P r .AO). 
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How Do Intended Cognitive Responses Relate to Achievement ? 

To investigate whether students' use of intended cognitive 
responses reflected by the written components of the instructional 
responses was related to their achievement , correlations were 
calculated between behavioral indicator cores and achievement 
scores (sec Table Q). These correlations must be interpreted very 
cautiously owing to the small group sizes, Nonetheless, the data^ 
are quite clear in showing that consolidate intended cognitive 
responses evidence no statistically reliable (p > *10 for all 
correlations, two-tail tests) relationship to achievement across 
both curricula in either group* In contrast* the correlations 
between students* compare-and-contras t intended cognitive 
responses with the achievement measures on the sleep curriculum 
are generally strongly positive and usually statistically reliable 
despite small sample size in the worksheet-plus^v ideetape group. 
Correlations between compare-and-contrast intended cognitive 
responses and achievement could not be calculated for the 
workshee t^only group due to zero variance on the intended 
cognitive response measure* None of the other correlations 
relating to the psychology curriculum reached an acceptable level 
of statistical reliability Cp ^ - 10 for all correlations, two- tail 
te^ts) . However, it should be remeOjired that these correlations 
are strongly affected by hotih small sample size and by outliers 
due td the few students who* provided fewer no behavioral 

indicators for consol idate intended cognitive responses during the 

/ X f ■ - ' 1 » 

psychdlogVH, lessons ^ ;,. c r- f - 

/The "corral a"£x oitb-\ We re quite low .between all measures of 

achievement. on the psychology curriculum and students 1 use of 

* » » " 
intended cognitive responses reflected by behavioral indicators of 

the 4 consolidate and the compare-and-contrast strategies* This 

J*. - ' ' - 

^ame lack of relation was found in Study II. In Study II, 
however, there were moderately strong and statistically reliable 
correlations between "behavioral indicators for consolidate 
instructional responses taken for the sleep curriculum and several 
indices of achievement from both curricula, whereas these 
relations were not replicated in Studv TIT* Rather, the trained 
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TABLE 9 



Correlations Among Behavioral Indicator Scores and Achievement 
for Students Trained to Use Worksheets 
St tid v rn 



Behavi oral Tndi Gators 



SI eep 



Fs yehol o^y 



nompare- Compare- 
and- and- 
Achievement Measures Consolidate contrast Consolidate contrast 



Sleep 

Mul ti pleach pice 

Attributes recalled 

Compare^and— cont ras t 

Total essay 

Psychology 

Mul tip! e^cho i ce 

Attributes recalled 

Compare- and -contrast 

Total essay 

Delayed Psychology 
Multiple choice 

Attributes recalled 

Cotr = ire - and -contrast 

Total essay 



-31 
^04 
-09 
= 19 
^06 
-20 
-11 
^25 



-2b 
= 24 
03 
-1 1 
-16 
^30 
-06 
-14 



-46 
03 
-10 

-13 
-27 

-11 
-11 
-05 



67* 
54* 
%5* 
SO 

IS 
68* 
57* 
71* 

33 
53 
61* 
59* 



22 
04 
25 

-17 
34 

^19 
32 

-06 



-14 
35 
34 

-05 

24 

03 

30 
08 



09 
= 06 
1 3 
40 
02 
OS 
09 
27 



-1 3 
06 
] I 

19 

^!»4 
25 
09 
24 



Note: Upper numbers are correlations for the Worksheet only group 

(N-7)* Lower numbers are correlations for the Worksheet =pl us— 
videotape group (N^10) 6 Correlations could not be computed 
between sleep compare— and— contrast behavioral indicator scores 
and achievement for the Workshee t-on 1 v group due to zero 
variance on the behavioral indicator variable* Decimals are 
omitted on correlations. 



* P < .05 



group in Study III that was comparable to the trained group in 
Study II (vidnotepe-plus-worksheet) evidenced moderately strong 
and stat is t i ca 1 1 v reliable correlations between behavioral 
indicators of the compare-nnd-contrast strategy taken during the 
sleep curriculum and aeh ievement indices for both curricula* 
Unfortunate] v, the zero variance for the compare-and-contras t 
behavioral indicator scores taken during the sleep curriculum in 
Study II prohibits calculating this correlation in Study IT and 
comparing the correlation to that observed in Study III, 

It is clear from both Studies II and III that students are 
quite capable of acquiring both types of cognitive strategies. 
Furthermore, it is equally clear that using at least one strategy 
correlates with achievement, What is pur.gling is why the 
correlation between use of^ the consolidate response strategy and 
achievement was unstable, Our speculation is that there «t^e 
variables we have been unable to control or manipulate in these 
studies that influence this relationship. 

The correlations indicating transfer of the response 
strategies from the sleep to the psychology curriculum were 
moderate to strong for both studies (,44 for consolidate in Study 
II, ,80 for consolidate and ,67 for compare-and-contrast in Study 
III)* These correlations indicating transfer of response 
strategies would lead one to expect that correlations between use 
of the response strategies and achievement observed in the sleep 
curriculum also would be observed in the psychology curriculum, 
We have no explanation why this expectation was not achieved. 
While we believe that our methodology in Studies II and III has 
made progress in specifying components of the instructional 
environment that influence students ' cognitive mediations of 
teaching and their subsequent achievement, we still lack a theory 
of sufficient explanatorv power to account for the differences 
observed between the two studies. 

Do Intended Cognitive Responses Enhance Learning from Instruction ? 

To examine relationships between training students to make 
intended cognitive responses and their achievement , several a 
priori comparisons were structured in the context of a backward 
selection regression procedure. In these analyses, as in Study 
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II, there were three major categories of predictors. The first 
category included only students 1 vocabulary scores, deviated about 
the grand mean* The second major category consisted of a set of a 
priori contrasts designed to provide information about differences 
between groups of particular interest. The contrasts are 
presented in Table 10. The first contrast examined differences 
between the two groups of students who viewed the videotapes 
without worksheets where one of the groups had been trained to 
make intended cognitive responses when presented with prelections 
of worksheets* The second contrast specified differences between 
the two groups who watched the videotape and had worksheets, one 
of which had been trained to make intended cognitive responses and 
provide behavioral indicators on their worksheets. Contrast three 
defined the difference between two groups^ that were trained to 
make intended cognitive responses, but which differed in whether 
these cognitive responses also involved providing behavioral 
indicators* The difference between these two groups was 
operationalized as having worksheets upon which behavioral 
indicators could be made versus viewing a projection of the 
worksheet* The fourth contrast examined the effects of training 
students to make intended cognitive responses when they were 
provided only with the worksheets versus being able to watch the 
videotape and use the worksheet* Thus, contrasts one and two 
explored the relative contribution of training students to use 
intended cognitive responses within one training mode. Contrasts 
three and four compared the training components from Study It and 
tested the relative contribution each component made to the 
combined training: condition. 

The third ma )or category of predictors considered in these 
analyses were aptitude-treatment interactions* These were created 
by multiplying each a priori contrast vector by the vector of 
vocabulary scores deviated about the grand mean, 

As was the case in Study IT, the vectors representing all 
these predictors were entered into the regression analysis at its 
first step* Thereafter, predictors that did not account for a 
statistically reliable portion of variance in the dependent 
variable (p y * 10) were removed from the equation until only 
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TABLE 10 
A PHoH Contrasts Among Groups 



Untrained 



Trained 





VI deotape 


Videotape + 


Worksheet 


Videotape 


Videotape + 


Contrast 


only 


Worksheet 


On! y 


Onl y 


Worksheet 




-1 


0 


0 


I 


0 


n? 


0 




0 


0 


1 


rn 


0 


0 


0 


-1 


I 




0 


0 


-1 


0 


1 
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predictors meeting this criterion for statistical reliability 
(p £_ *10) remained. 

Descriptive statistics for the vocabulary and achievement 
data from Study TIT are presented in Table 11. The results of the 
regression anal yaes and ef f ee t sizes for the n pr i or I cone ras t s or 
aptitudes-treatment interaction terms involving an a priori 
contrast (differences between adjusted means divided by the square 
root of the residual mean square from the regression analysis) are 
presented in Table 1 2 . Group differences are reported if they 
describe effects that would be statistically reliable at least ten 
times per hundred comparisons (p <^ .10)* As in Study TI, this 
more than traditional allowance for type 1 error was made since 
this experiment was exploratory and involved very small group 
sizes. 

The results of these analyses are quite varied* They are 
reported here organized according to the contrasts that were 
inves%igated and according to the order in which the achievement 
measures were collected, i*e«, sleep, psychology, and delayed 
psychology achievement tests. Main effects for all of the 
contrasts are discussed first, followed by consideration of the 
apti tude- treatment interactions* As is discussed below, by far 
the most interesting and theoretically rich information is found 
in results involving aptitude-treatment interactions, 

Table 11 summarizes the results of the 12 regression analyses 
reported in Table 12* It is organized by contrast and shows the 
dependent variables that were involved in reliable group 
differences, as indicated by the main effects portion of the 
table, and those that were dependent upon vocabulary by g^oup 
aptitude- treatment interac tions . 

Ab one* would expects vocabulary scores were rel i abl 1 y related 
to achievement test scores, contributing between five to 24% of 
the variance in the dependent variables. The main effect term for 
vocabulary score remained in 11 of the 12 equations, failing to be 
retained only in the equation where the psychology compare-and- 
contrast score served as the dependent variable* 4 But even in this 
equation, vocabulary was associated with a statistically reliable 
aptitude-treatment interaction term, 
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Correlation? Aaeng 
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Vocabulary and A£hifv#sgRt Variables 














V 

e&ntrol 




y 

only 


¥ 

enly 




3 4 5 6 7 

is 


8 


9 


10 


11 


12 


13 


I. Vpfabul 4ry 


24,70 
4,85 


24,67 
3.64 


22.43 
5.86 


19.63 
4,07 


24,70 79" 42 
S.56 


42 , 45 43 46 33 


31 


35 


40 


37 


31 


32 


1, My! t ipl e=^hr irp 


.'.ft 


5, Si 
1.17 


5,00 
2,24 


4 S 75 
* 2,49 


6,60 72 
1.65 


39 39 44 23 14 


08 


19 


37 


12 


16 


16 




3.70 
K64 


5.33 


14 

2.85 


4.13 
2.39 


4,40 
IM 


85 90 54 52 61 


53 


51 


55 


55 


57 


59 


Contrast 


1.65 


7 ,22 


6.71 
3.35 


5.18 
2.53 


5. SO 
3,61 


77 97 45 60 


63 


67 


45 


60 


70 


69 


5. S.ifes T?Nl F^ss? 


11.20 
3.58 


13*67 
SJ.l 


12,00 
6,0* 


10.25 
4.68 


10,10 
6,44 


B* 48 60 


56 


64 


50 


61 


66 


67 


ehsiee 


]4 t &Q 
3,24 


17,33 
2,4^ 


14J6 
2.79 


15,13 
2 JO 


17.50 
2,83 '* 


54 45 


kh 


43 


10 


45 


44 


46 


Recalled 


4,20 
2,25 


3.56 
3,88 


4,14 
3,13 


4,50 
2,78 


4,90 
3,41 


72 


80 


91 


49 


14 


73 


79 


8. Fa vehol pgy Cnspjfe^iind 


s.so 

2.01 


7,67 
4.80 


7.71 
3.-45 


8,13 
3,48 


7,50 
4,04 




71 


93 


40 


65 


84 


76 


§. Psvehelqgy ToUl Essay 


15.10 
4.28 


15.11 
8.52 


12.57 
4,89 


13,00 
4 S 90 


13,50 
7.06 






73 


44 


76 


84 


84 


10. Belayed HuhipIf-ehoiEe 


14,40 
4,14 


12.56 
3, 32 


13,57 
2,88 


15. M 
3,25 


17.60 
3, 37 








61 


50 


41 


46 
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2,47 
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3,41 


3,57 
2,82 


4,25 
3,41 
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TABLE 12 



Backward Selection Reafesilfin Anal v^eN 
Study ITT 



Dependent Variable 


Pfedl rEera 


0 


F/t ! 




y 

vnf! tifi Ct i 


F- 


Sleep 










- 




Hul El pie ehel ee 


Total equation 




7 ,09 


. ,01 


, 10 






Vocabul af y 




1 .*7 


, 1 o 


, *>5 






CI 


-.36 


-2,70 


, 01 


, 1 2 


-1 ,65 




Veeab x n2 


. 27 


7 , Of 


, 05 


. 07 j. 






Constant 




23,93 


?,0i 






Attributes Recalled 


Total equaElgn 




■3,76 


< ,01 


. 25 






yeeahul ary 


.52 


3,70 


, 01 


.24 




• 


Cl 


, 30 


2,07 


. 05 


, 07 


- 




Veeab x Cl 


* 28 


2 * 08 


, 04 


, 08 






Constant 


C 4,77} 


13,92 


c: , 01 






Coopare-and-eont rss C 


Total equation. 




7 , ^0 


"' ! , 01 


, 33 






Voeabul ary 


, 36 


2,73 


".01 


.12 






C2 


28 


-2.17 


,04 


,07 






Vscab x C2 


^40 


2 , ^2 


« _ 01 


s -j ^ 


, 64 




Cons t an t 


( 6i*t3) 










Essay Total 


Total equation 






* s 01 


, ? 7 






Vocabul ary 


i 35 


2,57 


* a 01 


, 1 1 






C2 


-.11 


-7. 11 


, 01 


, 09 


■ _ 




Veeab % Cl 


, 32 


2, 28 


,03 


. 1 1 


-,79 




Cons t ant 


f 1 1 4 5 ^ 


1 ft 83 


« m 






Psychol ogy 














Multiple choice 


Total equation 




6 * 71 


*,0l 


. 27 






Vocabul Afys 


48 


3 43 


* 01 


20 






Cl J 


35 


' 35 


02 


09 






C3 S 


, 27 


1 , so 


. OR 


. 06 


,90 




Constant 


fl 5,97) 


40, ft! 


**01 






Attributes recalled 


Total e qua t f on 






, 03 








Vocabul ary 


, 33 


2,25 


. 03 


, 1 1 






Constant 


f 4,68^ 


1 0,71 


S 01 






Coups re*"snd=eentrast 


Total equation 




6,91 


. 01 


,12 






Vocab % C2 


, 38 


7, fi3 


. 01 


.14 


, 33 




Constant 


f 8 . 01 1 


16,15 


01 






Fsaay Total 


Total equation 




4, Rl 


. 01 


,1 5 






Voeabul ary 


, 20 


2 . 02 


. 05 


. OS 






Vocab 3? C2 




1 ,75 


. 09 


,06 


,44 




Constant 


H3,94l 


16,69 


,01 
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Dependent Variable Fredtcters S F/t* p variance^ E 



Delayed FMyehalogy 


















Multiple choice 


Total equation 




5. 


. 3S 


< 


,01 


.23 






Vorsbulary 


*£3 


3, 


.02 


< 


.01 


.16 






CI 


.23 


1. 


.67 




.10 


,05 


.33 




C4 


.27 


2, 


.03 




, OS 


s 07 


1,08 


/ 


Cons t ant 


fl 5-77) 


32, 


.11 




, 01 






Ace rt bates rtda tied 


fetal equacien 




4. 


.89 




. 01 


,1 5 






Voeahul af y 


.35 


2, 


. 46 




,02 


. 1 2 






Vo ea b x C 3 




1 , 


t 71 




,10 


5 0H 


.IS 




Constant 


C 4 S 2Q) 


9 


.62 




. 01 








Total equation 




5, 


04 




.01 


.16 






YOcabul ar y 


.27 


1 , 


fl 






.07 






VOeab % C4 


,32 


2. 


29 




, 01 


.10 


,17 




Constant 


f 7,811 


1 5. 


87 


< 


,01 






Essay total 


Total equation 




5 a 


,47 




,01 


,17 






Vocabul ar y 


,28 


2. 


,03 




, 05 


.OS 






Voeab x C4 


,33 


2, 


36 




02 


.11 


,17 




Cons Cant 


n ?,75> 




94 




,01 







1 F-statistlcs art reported for the regression equation containing all predictors 
regaining in the equation (p <,10); t^stattstfci are reported for each 
predictor's slope coefficient. 

a _ __ =_ 5 

- The figure reported far the Total equation Is R- adjusted for shrinkage. Thoae 
associated with each predictor are squared part for aesit parti al ) correlations, 
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TABLE 13 



Summary of Statistically Reliable Effects Involving Contrast 
Coded Vectors from Backward Selection Regression Analyses 

Study TTT 



Contrast 



Dependent Variable 



Pi rec tion of 
Effect 



Main Effects 
1 



ATI 



3 
4 

1 

2 



3 
4 



Sleep multiple choice 
Sleep attributes recalled 
Psychology multiple choice 
Delayed psychology multiple choice 

Sleep compare— and-contrast 
Sleep total essay 

Psychology multiple choice 

Delayed Pychology multiple choice 



Sleep attributes recalled 

Sleep multiple choice 

Sleep corapare-and-contrast 

Sleep essay total 

Psychology eompare-and-eontrast 

Psychology essay total 

Delayed Psychology attributes recalled 

Delayed Psychology compare-and-contras t 
Delayed Psychology essay total 



+ 
+ 



+ 



+ 



Note: The direction of effect for the aptitude-treatment 
interactions indicates the slope of the regression 
line for the trained group* 
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The first contrast compared the two groups that viewed the 
videotapes where one of the groups was trained to make intended 
cognitive responses and one was not. On three of the dependent 
variables (sleep attributes recalled* psychology multiple choice* 
and delayed psychology mu] ci pie choice)* students trained to 
execute intended cognitive responses outperformed their untrained 
counterparts * The effect size statistics for these three 
dependent variables indicate that the average trained student 
performed at t e 67th, 68th and 63rd percentiles in contrast to 
the average student in the comparison group for these three 
dependent variables* respectively, However* on the sleep 
mul t iple^choice test* the comparison group considerably 
outperformed the trained group* The effect size was a large 
—1,65 j indicating that the average trained student scored at the 
fifth percentile on this scale in contrast to the average student 
in the comparison group* 

From these analyses, it would appear initially that training 
students to use intended cognitive responses on material projected 
by an overhead had deleterious effects on achievement* 
particularly with respect to cued recall on the mul tiple^uhoiee 
test* There was a modest positive effect of this training on the 
number of attributes students recalled on the essay test, which is 
more akin to a free recall task* However, this relation vanished 
on subsequent tests measuring transfer to the psychology 
curriculum* where it was replaced by reliable* but modest, effects 
on both the psychology and delayed psychology mul tiple^choiee 
tests, 

The second contrast compared the effect of training students* 
in intended cognitive responses by using both videotapes and 
worksheets with a group that used the same materials but was not 
trained to make intended cognitive responses* This contrast 
replicates the between^group comparison in Study II, Main effects 
for this contrast^ were found on two dependent variables, both of 
which were derived from the sleep essay test* On both sleep 
cofflpare-and^contrast and sleep essay total scales, the comparison 
group had* on average f higher scores than did the trained group* 
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Both of these effects were fairly strong, wich the average crained 
student scored at the 26th percentile in contrast to the average 
comparison group student on the sleep compare=and=conc rase 
variable* The effect size for sleep essay, total score placed the 
average trained student at the 21 st .percenti 1 e relative to the 
average comparison group student* The main effect for the 
contrast for these two groups did not appear in the analyses of 
the psychology or delayed psychology test data. 

These data suggest that the , Era i n f ng * was deleterious Jigain, 
at least with regard to its immediate effect. Some modest support 
from training emerged on the psychology and delayed psychology 
multiple-choice tests, hut the support was not startling* 
However* the apti tude^treatment interaction analyses modify these 
interpretations considerably* Before turning to discuss these 
more, complex findings* the data comparing the full training 
package ( videotape-plus^worksheet ) to the vi deotape^only and 
worksheet^only training groups are presented* 

Contrast three compared the vi deocape^onl v group to the , 
yideotape-plus^worksheet group* Contrast four compared the 
worksheet-only group to the videotape-plus-worksheet group* There 
was an effect for the former on psychology mul E i pi e=choice and for 
the latter on delayed psychology multiple-choice scales* Both 
effects were somewhat strong, elevating the average student in the 
group receiving full training ¥ in contrast to the average student 
in the respective comparison group* to the 81st percentile for 
contrast three and the 86th percentile for contrast four* Thus* 
there appears to be no support for the hypothesis that the 
worksheet and videotape components of the training are 
debilitating when used jointly* 

There were nine statistically reliable aptitudes-treatment 
interaction terms in the regression analyses* All indicate a 
positive relation between vocabulary score and achievement for the 
students trained to use intended cognitive responses, and a 
negligible or slightly negative relationship between vocabulary 
and achievement for the untrained students in the comparison 
groups* 




Contrast one was involved with only one 5 apti tude^treatment 
i nterac t ioir term involving the number of attributes recalled in 
the sleep essav test, In. this case the slope for the videotape- 
only treatment group was ,48, and the slope for the videotape-only 
comparison group was ,03* 

Contrast two was im*olved in five aptitude- treatment 
interaction terms, by far the most of all the contrasts. These 
aptitude-treatment interactions indicate that students with higher 
verbal ability^ as measured by the vocabulary test, had higher 
scores on the various achievement tests only if they were trained 
to make intended cognitive responses* ' The relationships were 
negative between verbal ability and achievement in the untrained 
group for all of the aptitude-treatment interactions involving 
contrast two. The range of raw regression weights for the trained 
group in these seven dependent variables was from .27 to *94* 
while, the range for the comparison p^oup was from -*08 to -.42* 

Contrast three interacted with vocabulary on the scale 
measuring the number of attributes recalled on the delayed 
psychology test. The regression of the number of attributes 
recalled on vocabulary for the vi deotape^plus-worksheet trained 
group resulted in a regression coefficient of *42 f while the 
comparable statistic for the Videotape— only trained group was 
-,01* Similar aptitude^treatment interaction terms were found for 
contrast four on the delayed psvehology test. On the essay total 
score and on the eompare-and— contrast score, the videotape— plus- 
worksheet students with higher vocabulary scores achieved more 
highly than both their lower ability peers in the same group and 
the students in the worksheet-only training group* 

CONCLUSIONS TO THIS POINT 
The results of Study I indicated that students were 
eognitively active as they responded to teaching in classrooms, 
The data showed, that teachers' intentions for students' cognitive 
processing and students' reports of the cognitive responses they 
thought their teacher intended them to use were sometimes 
mismatched* As well, there were instances where these appeared to 
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be a High degree of correspondence between teachers ! intentions 
and students 1 cognitive responses* We Interpreted the findings 
from Study I to hold promise for the cognitive mediations! model 
as a means for guiding research and suggested that the phenomena 
warranted experimental analysis, Studies TT and TTf were 
designed, in part, to determine if elementary school students 
could he taught to respond to instrutional stimuli systematically 
with strategic cognitive operations, 

Studies II and III provide abundant evidence that students 
can acquire cognitive strategies for learning in classrooms and 
that these strategies can be employed by students in a simulation 
of classroom tasks and conditions. Students in three groups in 
the two latter studies provided evidence that they used the 
intenBed cognitive responses that they had been taught in training 
sessions by tracing components of these strategies on the 
worksheets. All participants in the trained group in Study IT and 
in the worksheet^only group in Study III obtained perfect' scores 
on" the behavioral indicator for the compare-and-contra-st cognitive 
response for the sleep curriculum* The other group trained to use 
worksheets in Study III* videotape^plus-worksheet , had nearly 
perfect scores (M=3*6G, maximum score of 4). For the consolidate 
response, the mean scores for these three groups ranged from 75% 
to 93% of the maxiumum score* 

It was not difficult to train students to make intended 
cognitive responses during instruction that also could be 
manifested in observable performance* This finding is valuable 
for three reasons. First, that students did not rebel at the task 
of learning or using intended cognitive responses during teaching 
sustains the applicability of the cognitive mediational model as a 
potential guide for helping students to profit from teaching. 
Second, this finding bodes well for future research about the 
cognitive mediational model* Researchers will be able to design 
treatments that include students 1 cognitive mediations as 
independent variables in experiments by training these mediations 
first, and then verifying that students use them during 
teaching* This check on implementation va 1 i d i t y is a necessary 
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step in creating valid explanations about whether and how teacher 
behaviors relate to students' achievement by influencing students' 
Chinking during instruction (Dovle, 1978; Winne ? 1982 a* b) . 
Finally, the fact that students can manifest aspects of their 
cognitive activities during teaching can provide teachers with 
evidence about how well students are following the plan of a 
lesson from moment to moment s Such interctive data describing how 
students are cognitively manipulating content to be learned may 
become an important input to teachers f interactive decision 
making, supplementing information about what students have 
acquired at particular- points in lessons (Marx & Winne, 1981), 

In a sense, establishing whether students could he taught to 
use cognitive strategies was the easiest question to ask and to 
operational i^e, More difficult questions can be raised that 
address the coordination of the two cognitive strategies by 
students as they learn from teaching, the transfer of the 
strategies over time from one curricular area to another, and the 
utility of the strategy for acquiring curriculum information 
during instruction and subsequently retrieving it in response to 
test v _questions. These latter questions were far less successfully 
answered by the latter two studies. 

The best set of data forNexamining whether students' were 
able" to use both strategies that they were taught to apply during 
the videotaped lessons was in the psychology curriculum, Because 
of the zero variance in two of the trained groups in the compare- 
and^contrast behavioral indicator for the sleep curriculum, 
correlations could not be computed that included the sleep 
compare-and-contrast behavioral indicator data, Usable data were 
available, however, for both behavioral indicators obtained during 
the psychology curriculum for all three groups in the two studies 
who were trained to make behavioral indications of cognitive 
responses. 

In Study Tl, the correlation between the two behavioral 
indicator scores for psychology was unexpectedly =,52, Assuming 
that the behavioral indicator data reflect students' use of the 
cognitive responses in which they were trained, this correlation 
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shows that the students could not manage to use* both responses 
during lessons as we had intended, But the correlations between 
use of both strategies in Study ITT were .22 for the videotape^ 
plus-worksheet group and . 58 for the worksheet-only ^roup. Given 
that means were high for behavioral indicator scales during the 
sleep curriculum, some students under some conditions were quite 
capable of executing both cognitive strategies during both sets of 
lessons . 

Several speculations can be offered about why the stability 
of use of the intended cognitive responses was not higher. First, 
although the students in the two studies attended very similar 
schools serving what appeared to be similar populations, there may 
have been individual differences among the students related to 
between-school factors aero, § the studies that influenced the 
results. The vocabulary scores for groups in the studies suggest 
that the two samples were similar, at least in this respect, 
However , there may be individual differences arising from factors 
other than verbal ability that may have influenced students 1 
acquisition and use of the instructional responses we trained, In 
paricular, some students may be more capable than others at 
perceiving teachers' intentions for cognitive processing. 

We have demonstrated in another study (Marx, Winne, & Howard, 
1982) that individual differences in locus of control and field 
independence "were not related to students' ability to perceive 
cues that teachers use to signal their intentions for students 1 
cognitive processes. However, both vocabulary and aptitude for 
perceiving instructional stimuli were related to students 1 
achievement (see also Stayrook, Corno, & Winne, 1978), Both the 
Marx et al, (1982) study and Studies IT and III reported here were 
based on videotape simulations of recitation teaching. Thus, it 
becomes doubly hazardous to generalize these unstable findings to 
classroom contexts. Research in naturally constituted classrooms 
is needed to explore these relations among aptitude for perceiving 
intended cognitive responses and achievement in more ecologically 
valid settings. The five related studies reported in the next 
chapter are one such extension, 
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A second possible source of instability in the findings of 
Studies T T and TTT relates to the consistency in delivery of the 
training cross the two studies. Training for the videotape^plus^ 
worksheet comparison group and the vi deotape^plus-worksheet 
trained group were del 1 vered" by different trainers in the two 
studies* While we attempted to control most of the parameters of 
training instruction to make them constant (e.g., by controlling 
time of exposure , directions, content students worked with, and 
comprehensively scripting the training activities), differences 
due to trainers may have occured. However, we have no data 
available tlj explore this possibility, 

A third possible factor that might help explain the 
inconsistencies has to do with the behavioral indicators, It is 
necessary to verify the occurranee of the cognitive response if 
one wants to test hypotheses abouc cognitive events in 
classrooms. Experimental psychologists frequently use response 
times or measures about the organization of responses as data upon 
which to base speculations concerning inferred cognitive 
processes. Obtaining response times is extremely difficult in 
classroom research for obvious methodological* and technical 
reasons* We made use of organization of responses through the 
scoring system for the essay tests, But the arguments put forth 
in Chapter I claim that more immediate, in vivo data are required 
to verify that the hypothetical cognitive processes, the intra- 
instruc tional cognitive events that are the putative cause of 
learning, actual ly occur. Relying only on retrieval data as 
represented by tests of cued or free recall only partially 
reflects aspects of the acquisition environment where interactions 
among delivery variables, acquisition processes, and retrieval 
processes take place. Yet, clearly, it is the acquisition 
environment and its interactions with other facets of instruction 
Chat are most central Co a study of teaching effectiveness*. 
Jlence , we developed thn methodologi cal feature of the behavioral 
indicator to attempt to operational ize the occurence of students 1 
cognitive processes as they occur during learning* 

One of the unfortunate features of the behavioral indicator 
is that the learner must devote time and cognitive resources to 
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the task of creating it. It is possible that the investments 
needed to create the behavioral indicator interf re with or, at 
least, diminish resources devoted to processing inherent in 
carrying out the cognitive strategy per se, Put differentlv, our 
insistence on operat iona 1 iz\ ng students 1 on-the-spot cognitive 
response by requiring them to produce behavioral indicators may be 
counterproductive. Even though we have data from the training 
components of Studies IT and TIT showing that students can acquire 
the cognitive response and^ use the behavioral, indicator, hindsight 
raises doubts that they achieved: high levels of automaticity of 
these processes as a result of the training they were given, 
Hence * when put into a situation where they were not guided 
specifically by a trainer, their performance deteriorated over 
time. 

Finally, Studies TI and Til provide evidence that students' 
use of the cognitive strategies we have created can influence 
learning. The correlational evidence showed that more frequent 
use of the strategies during the sleep curriculum was associated 
with higher achievement on the psychology curriculum* This effect 
occured with the consolidate instructional response in Study TT 
and the compare-and-con t ras t instructional response in Study 
III. Beyond noting the inconsistency across studies, we are 
unable to explain what caused the ins tahi 1 i t v o f relationships 
between use of the two instructional responses and subsequent 
achievement* 

Several aptitude- treatment interaction terms emerged from the 
analyses of Study III data. The most frequent of these involved 
the contrast between the videotape-pl us-worksheet conditions, one 
of which received training in cognitive responses, and one that 
did not* "All of these interactions showed that students with 
higher vocabulary scores who were trained to use cognitive 
responses were more successful on the achievement tests than low 
verbal ability students, while the reverse was true in the 
comparison group, This finding is supportive of the cognitive 
mediational model, although one would hope that these aptitude- 
treatment interaction effects would he attenuated by increasing 
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the degree to which the low ability students could use the 
cognitive responses* produe t ive 1 y * 

Of course, one could speculate that more robust effects of 
cognitive strategy usage on achievement did not emerge because the 
two cognitive strategies we trained were simply not very useful* 
While this interpretation must always be considered in research of 
this genre, it Ls not favored here because large bodies of 
literature on human learning show that the cognitive responses we 
trained students to apply to content have a solid history of 
promoting learning (e.g,, see Doyle, 1980), Perhaps learning from 
simulations of interactive classroom teaching is radically 
different from the settings out of which these positive findings 
arise* Although we doubt this, too, the differences do need 
further specification (Snow, 1974)* The next set of studies 
address some of these issues- 
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CHAPTER 5 

Training Students to Respond Strategically to Their 
Teacher's Instruction: Five Classroom Studies 

INTRODUCTION 

The studies described to this po^nt in our program of 
research provide three maior conclusions! about how the cognitive 
mediational paradigm relates to conceptions of teaching and to 
students* learning from teaching. The first study demonstrated 
that teachers and their students operate in ways that clearly 
reflect the mediating role of students 1 cognition in teaehers , 
choices about instructional actions and in students' learning from 
teaching* Specifically, teachers^ attempt to influence the ways 
that students cognitively process inf ormation* and students 
respond* sometimes idiosyncratical ly* to perceived instructional 
events by engaging cognitive strategies that they activate either 
automatically or as a result of some amount of decision making. 

The second maior conclusion* arising out of the second tmd 
third studies, is that students can be trained to discriminate ' 
instructional stimuli from other events that occur during 
teaching* and to engage pre-arranged cognitive strategies upon a 
teacher's delivery of instructional stimuli* This provides 
evidence that teaching can do more than merely respond to the 
array of individual differences students display* Specifically* 
teaching can take some hand in shaping how students learn, as well 
as what they learn* by instructing students about links between 
instructional stimuli and cognitive strategies that can support 
learning* Tn effect* this validates the idea that teachers may 
facilitate students 1 learning by providing students with an 
enabling curriculum that consists of declarative and procedural 
knowledge about the cognitive activities involved in learning from 
teaching (Marx & Wi nne , 1981) * * 

The third maior conclusion, also emerging from the second and 
third studies, as well as from prior research* is that students 1 
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achievement is partly a function of the cognitive strategies they 
activate in response to the instructional stimuli they perceive in 
teaching Moreover, the results of Studies IT and III demonstrate 
clearly that, under certain conditions, the cognitive strategies 
students bring to bear during teaching can influence learning 
deleteriously * Although we certainly did not plan to reduce 
students 1 achievement by training them to use cognitive strategies 
that were constructed from a foundation provided by hundreds of 
other studies in educational and instructional psychology, this 
did happen with some students* These negative findings, while 
perhaps explainable as due to a lack of automatieity in students 1 
use of new cognitive responses to teaching, rather than pointing 
to a potential weakness in the foundational research, only 
reinforce further the need to continue research on teaching from 
the perspective of students* cognitive mediation of instruction. 
This is particularly important because of the repeated aptitude^ 
treatment interactions showing that high verbal ability students 
were able to benefit from cognitive strategy training. 

The five experiments that are reported in this chapter were 
undertaken to explore further the interrelations among students 1 
use of cognitive strategies to learn from teaching and subsequent 
measures of their achievement* What distinguishes these 
experiments from the preced ing * pair are several features that help 
penetrate even further the black box of students* cognitions 
during everyday teaching* 

By the time students enter the upper elementary grades, it is 
almost certain that they have developed a repertoire of cognitive 
responses to the instructional stimuli that appeared in the 
thousands of lessons in which they have participated earlier* It 
seems reasonable to assume that, like in all other areas of 
learning, students^ will display individual levels of achievement 
both in the range of cognitive responses they make to 
instructional stimuli, and in their developed abilities to 
identify instructional stimuli keyed to specific intended 
cognitive responses (Marx et al*, 1982)* In other words, we 
hypothesized that students have deve 1 oped ,,d r f f erent level s of what 
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might he labeled "perceptual acuity" for intended cognitive 
responses. Students with different levels of this aptitude may 
respond differently to teaching* and this subsequently may 
influence their achievement* To explore this hypothesis, we 
devised a procedure to gauge students 1 aptitude for perceiving 
their teacher's intentions about students 1 cognitive responses 
during lessons, Scores generated by this procedure were treated 
as representations of an aptitude in our analyses of achievement 
data* 

k second feature of this last quintet of experiments that 
sets them apart from Studies IT and TIT is that we attempted to 
insure that students who were trained to make intended cognitive 
responses matched to an instructional stimulus did so more 
automatically than before, This goal was approached in several 
ways. Training sessions were longer .and slightly greater in 
number to increase opportunity to learn the instructional 
response. To increase the relevance of training, the medium for 
training was videotapes of lessons in which the students had 
participated only minutes prior to the training session, To 
promote automaticity in transferring training from videotape re- 
presentations of lessons to live teaching, we involved the 
students * respective teachers in the training. They retaught a 
brief section of the preceding lesson while students practiced 
identifying instructional stimuli, carrying out the associated 
in t ended c o gn i t iye r e s p ons e s ? __and ! _wr i t i ng d owti _b eh aviora 1 
indicators of their cognitive responses* 

A third feature of this final set of studies was the fact 
that they were carried out in an instructional context that was 
nearly identical to the context of these classrooms prior to our 
interventions, In fact, the only difference in the teaching that 
each of the five teachers delivered as a result of our work with 
them and their students was that, at ttmr*s the teachers thought 
appropriate (and that had been discuss- jrior to the lesson), a 
simple instructional stimulus was delivered, In every other 
respect, the nature of their Instructional delivery was left to 
their discretion, just as it would be had we not enlisted their 
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part i C ips t 1 on in Our research* With respect to scudents ' 



experiences, the only difference in Che instructional context for 
untrained students was that we distributed booklets in which they 
recorded class notes on paper which had two vertical lines 
dividing the page into three vertical sections. All students were 
informed that we would collect these booklets* Since each of the 
teachers in our s tud ies had involved their s tudent s in note taking 
prior to our entry into their classes* the main differences for 
students was the fact that someone other than their teacher would 
be examining the booklets, and that there were lines on the pages 
of these booklets unlike M plain fi notepaper* Untrained students 
were told to ignore these divisions because they were there only 
for the other group (trained students) in their class with whom we 
had been working* These minimal differences provided a 
naturalistic environment for the research that we judge to be 
nearly ecologically equivalent to that which students would 
normally experience in an average classroom in the participating 
school district* 

Tt is possible, of course, that reactive effects of our work 
with the teachers occured, and that these effects changed the 
classroom environment in such a way that it had different effects 
on learning than had the environment prior to our influence, 
However, to a very large degree, the question of this influence is 
moot because it is impossible to conduct research on classrooms 
without influencing the environment in some way* We judge that it 
is possible to reduce the confounding nature of these influences 
by working with the participating teacher in a collaborative 
effort* In this way, research questions and methodologies used to 
investigate these questions can he tailored to the idiosvnerac ies 
of particular classrooms, while still having sufficient 
experimental rigor to speak to a theory of teaching that extends 
beyond the boundaries of individual classrooms* The research 
design used for the five experiments reported in this chapter was 
created to take advantage of collaboration with teachers in the 
service of enhancing the value of our intrusion for the teachers 
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who worked with u-% -and extending the theoretical generality of 
our research* 

Overview of the gtijd ies .. 

All five st yd i e - reported in this section followed a coimion 
format eonsistii, 0? a preparatory period, during which tti^s 
research staff worke^rf with the participating teachers t& fevelop 
curriculum materials , and three subsequent phases constitute ing the 
experiments as such. Each study corresponds to a cljisfoOfa that 
participated in zhg ^ro ject. Because of platooning in fchi^s 
district (the same a^s for Studies It arid III), one of the 
teachers, Mrs, Chris (a fictitious name used to insure 

confidentiality) 9 tam^ight three of the five classes of sturi^srttg* 
Mr* Dixon and Mr # Yo~ rrester (also fictitious names) eaqh t^aught 
their own class* Th&m nature of work undertaken in this q t i— ^ Hy 
required that each t— ^eacher have constant and easy aceeas te^ a 
member of the regas^^ch team* Thus, at the first meetini tts^at 
initiated the period during whicH curricuiuni materials ^ers 
developed, each teac&er was paired with a research aaai.itflQt for 
the duration of thg ^study. 

During the pr©p^=sratory period f the entire research st^^ff 
worked with teacher^ to create curriculum materials and 
achievement tests th^^t would be used in the three phases the 
experiments. Three y^^rii ts of curriculum were developed s oflc^^ for 
each experimental p^aEseu The topics covered in the units ^ere: 
the human sense of hifcearing, the sense of vision, and an 
introduction to 1oca"L ecology, Although a large proportions of 
concepts and other aspects of these curriculum units vera 
comaprahle acrosj^fh^s five classes f there were important 
idiosyncracies as v^^Hl* This reflects our intent to coAduc= t the 
research in as ngtur^alistic a fashion as possible wliile uring 
that our data would qprovide a foundation for valid inter pre— cation* 

Following these cnrr iculum development activities, tfiesre were 
three phases to the ffitudv, The first phase, called the m^^^ping 
phase j was designed ^^o produce a comprehensive deseriptiQfi of the 
intended cognitive rMsponies characteristic of the Tigtyral 
teaching in each of ^the five classrooms* A four^lesgon uni__ t on 
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the sense of hearting served as the curriculum for Che mapping 
phase. The seeone=l phase of Che study, the training phase, was 
designed to train a randomly chosen half of the students in each 
classroom to use generalized intended cognitive response when 

prompted by their teacher's instructional stimulus- This training 
phase was carried out when the lessons comprising the unit on the 
sense of vision w«re taught* In the third phase of the 
experiraents f the ~impl ementation phase ? all students in each 
classroom part ici ^ Pated in recitation lessons about the ecology 
unit taught by th^eir regular teacher, The purpose of this phase . 
was to test wheth^ier the training that half the students had 
received in phage two would generalize to everyday teaching, and 
whether trained $ ^tudents 1 use of intended cognitive responses to 
their techer'a in structional stimuli would affect their learning 
of inf nidation in the ecology unit. The nature of each phase is 
described in jnore detail in the following sections* 



METHOD 

Context: Mr. _fj?r ^res ter ? Class A 

Part ie ipan |^_ - The students in Mr* Forrester's class were 27 
in a small elementary school , The school, 



grade six children 

which had one cja as at each of eight grade levels, is located in a 
middle soQioecori O^ m ic suburban area consisting mainly of single 
family dwellings* Students in Mr, Forrester's class were 
predominantly wtii te f though his class included approximately 20% 
Asian students , Of the 2 n children in the class* 15 were girls 
and 1 2 were boys* 

Class format _ Students normally were seated in rows ";f four 
or five but thil ~ varied depending on the nature of the lesson to 
be taught* Sfcude^nts felt free to move their desks before a 
lesson* though £h= is usually entailed moving closer or further from 
the board, Rare! y did students exchange desks or alter their 
position in ft tq\f^ * Two or three students were not in rows but 
were seated in jno^Ye private spaces in the class, either by a 
cabinet or n^ar bl _ corner of the room. 
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Mr, Forrester kept his desk at an angle to the class by the 
doorway to the hall. On one side of the class was a sliding 
screen separating Mr. Forres ter f s class from the adjoining grade 
five class. This screen prevented st ^ents from seeing activities? 
in the other class, but noise from the grade five class 
occasionally interrupted Mr,, Forrester's lessons. At the front of 
the classroom was a blackboard and lectern from which Mr* 
Forrester gave hi s lessons. Occasionally he would use the 
blackboard on the side wall, opposite the sliding screen. At the 
back of the class were several windows and a door to a playing 
Field, 

The classroom was filled with a wide array of resource 
material s including a collection of musical instruments and a 
micro-computer, Mr. Forrester had divided sections of the wall 
for posters and students* work relating to various aspects of the 
grade s*x curriculum. He a 1 so used charts to monitor student 
homework and other activities, 

Mr, Forrester tvpicaily used an inductive approach to 
teaching. He would usually begin a lesson with a review of the 
last lesson and a brief overview of the upcoming lesson, He would 
then ask a series of questions to cover the points In his 
lesson. , Mr, Forrester reacted encouragingly to students' 
responses while indicating the correctness of the response, With 
his guidance, more often than not the students eventually arrived 
at the intended learning outcome without Mr, Forrester having to 
state it outright! y. During this inductive process , Mr, Forrester 
permitted moderate background chatter and activity, never 
demanding absolute* undivided attention to himself. However s If 
the noise level became too blgh or the students* activity too 
obviously off-Cask, be meted out discipline quickly and 
ef f i cl entl y. 

Context! Mr, Dixon * Class B 

Participants , The students in Mr, Dixon's class were 20 
grade six children, ten boys and ten girls, in a large elementary 
school, The school is located in a middle socioeconomic suburban 
area consisting of single^famliy dwellings. The class, was 
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predominantly white although thore «sre about Asian 
students. -fr, DiKon taught: -^ftlf sci^nrn and social studies to 
this group. For the reffla^ ^H^^C^tSi thi s group was taught hv 
another teacher. 

HI ass format . During ftllkiit tl — le Inst two sessions fn the 
third phase of the study, class groups of four or five, 

each group at one of four* l a,^$i tahl ^=s * n the classroom. The 
desks of students fn Mr* D^ Kofi's hofii^=room class were spread around 
the perimeter of the roots ^Hcf m& nc^st used hv the class 
participating In this study %ftepE dLxjrlng the last two sessions. 
Fdr these lessons* the tahi hid be»n removed and the homeroom 
desks were put into convent ^1 tqiq^b * T he students sat where 
they wished, During the t rattling pn^sse of the experiment only, 
the group that received fcrgi^ingsat at the two tables nearest the 
video equipments During i Sfi— idencs remained at their 
tables except when shar peni pencil # using the washroom, or 
participating In a class ae c t vity. 

Mr. Dixon used a taM g For a lee— tern and positioned ft at the 
front of the classroom for a^gv access s 1 hi 1 itv to the nlackboard, 
Frequently during 1 essons, M^.Dixon used an overhead prelector* 
aimed at a screen to the stnff^s 1 rt Tsht- T he classroom was 
essentially undecorated/ onl y* few maps and some examples of 
students* work were hung »r» fcfetfa 1 1 - 

Mr* Dixon usual 1 v beR^n n lessors with a review of the past 
day's lesson and a brief oye^fe of the current lesson, He then 
would begin, using the^ bLa c k^flard or overhead prelector, to 
introduce the new matsria^ # Hf, Di^Qs^n encouraged students' 
questions, often using the^ ^^sta^cl points for a discussion of 

concepts specific to, or similar to h=3iit diverging from, those 
planned for a lesson. B^CgU^gaf th^s latitude he allowed in this 
latter respect, he did not a^wys Caamcb a 1 1 the material he had 
planned* 

Hontext: Mrs, Chrlstv, ^Igg^ftC^ and , F 

Mrs* Christy taught t^r^esci ene^e classes, all of which 
participated in this stuff y\ % arfe^ referred to as Classes n,D, 
and K . Classes C and D weya aiventb grade classes of 1? girls and 



ton hovq and 12 girls and 11 boys, res pecti vel y , Class E was a 
sixth grade class containing 14 hoys and 12 girls* The school was 
a large elementary school, situated In the suburbs and primarily 
populated by mi ddl e^cl ass families . Students in Mrs. Christy's 
classes were predominantly white, though classes included a small 
proportion of Asian students, some of which participated in an 
English as a second language course which kept them from attending 
some of the lessons involved in this study. 

Class format . Students in each class were normally seated In 
rows consisting of f^ur or Five pairs o^ desks each, hut this 
.varied depending on the activities for a lesson. On some 
occasions students changed desks, but this was usually the result 
of a disciplinary action by the teacher, Mrs, Christy was head 
teacher at the school and her lessons were frequently interrupted 
by the principal to discuss administrative matters, 5 , 

Mr?*, rhi *sty planned her lessons in detail and referred often 
to her written plan during instruction. She primarily used an 
inductile approach to teaching. Lessons usually began with a 
review of tbs main concepts covered in the last lesson plus a 
brief overview of the upcoming lesson. Her lessons were mainly 
teacher-centered and she di^ if.ost of the tal ki ng. As the 1 ess on 
developed, however, Mrs, Christv began to engage students in 
discussion. She Frequently used the board to draw diagrams and to 
write concepts that she wanted the students to copy into their 
notebooks. Although Mrs, nhrtstv was friendly, she did not 
tolerate chacter, and on several occasions students were 
reprimanded and asked to leave the classroom if they could not 
refrain from talking, Seemingly because of this restriction, the 
students took opport uh * ti es to chatter when the teacher was not 
instructi ng, 
Curri cul um 

The curri cul urn content for the three phases of the study was 
determined in a meeting involving all five researchers (the two 
principal investigators and three research assistants) and all 
three teachers, The criteria used to select content were: 




1) the information should he new to the students so that 
measures of Instructional effects would be sensitive to 
teaching that occured during the study rather than 
reflecting students' prior knowledge* 

2) the content should fit the individual teachers* 
objectives and preferences as much as possible; 

3) the material should be wel ^structured yet lend itsel f to 
the various kinds of testing, training and analysis that 
the study requires* 

After careful consideration of these criteria, the teachers 
and researchers agreed that the subiect areas that would be taught 
tn the study would center around the science program for the upper 
intermediate grades, specifically dealing with the sense of 
hearing for the first phase of the s t ud y y the sense of vision for 
the second phase, and the science of ecology for the third phase. 

The process for developing the science units following this 
meeting began by informally observing one or two science lessons 
in each class. During these observations, the amount of content 
fe.g., number of concepts) and duration of a typical science 
lesson were assessed. Based on this information and subsequent 
discussions with all three teachers, it was decided to plan four 
lessons in the unit about hearing, six lessons in the vision unit, 
and eight lessons in the ecology unit. 

Following this prellminarv work, the research team developed 
a general first draft of the curriculum that could serve as a 
stimulus to which the teachers could react* Based on this gl oba 1 
plan for the curriculum, the teachers were asked to begin 
preparing an outline of more specific topics that would be covered 
In their lessons* 

At a second meeting two weeks after the first meeting, the 
research team and all the teachers met for a full day to outline 
in more detail the major aspects of content for each of the three 
science units, During this meeting, each teacher and the research 
assistant assigned to him or her began to plan the overall 
structure of each unit and to list concepts to be dealt with in 
the lessons within those units. Tn addition to personal 
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knowlndgp, qnvpral sources were used including: Exploring t lying 
Things: Laid law Exploring Science Program C1977) ; Stecher et al. 
(1976^ Program nn Teaching Effectiveness (1976); and several 
introductory psychology texts* 

To provide for differences among the teachers in their 
objectives and preferences, the researchers and teachers had 
several subseuqent, often daily, meetings to add to and alter the 
agreed-on outline of concepts* The units and lessons that emergec 
from these adaptations are out^'ned in Appendix E. Since there 
was no intent to pool the resu,,,, across the teachers' classes, 
these modifications to the general outline of the curriculum were 
expected and accepted in compliance with our second criterion for 
curriculum materials for the study* 
Mappi ng 

The goal for this first phase of the study was to produce a 
"map 11 of each teacher's characteristic intended cognitive 
responses. To accomplish this* a procedure based on that for the 
first year of the project was used to videotape each teacher's 
lessons and obtain his/her interpretations about intended 
cognitive responses in an interview following the videotaping. 
The procedure was as follows. 

The teacher's research assistant set up the videotape 
equipment before class* Then s/he videotaped the lesson and took 
brief notes about incidents in the lesson that might contain 
intended cognitive responses. These notes and the corresponding 
segments of the videotaped lesson would be analyzed during the 
teacher interview. Criteria for identifying these events for 
later analysis were general. The research assistant had to be 
able to identify a possible cognitive response that students might 
use in response to an instructional event, The research 
assistants were prepared for tins task through practice in a pilot 
study. After videotaping the lesson, the research assistant moved 
the equipment to another room and reviewed the notes to prepare 
for the inte rviiw that followed within an hour of the lesson. 

The post^lesson interviews of the teacher ranged in length 
from 25 to 40 minutes and were audiotaped for further analysis. 
In the interview, the teacher viewed the videotape of the lesson^ 
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and was asked to stop che videotape an points where s/he intended 
students to think in specific ways in response to particular 
teaching events* The teachers were prepared for this task prior 
to the first videotaping by a discussion of about ten minutes in 
which the research assistant described several intended cognitive 
responses identified in the earlier studies and provided several 
examples of each* However, if a teacher passed over a large 
portion of instructional events that had been noted by the 
research assistant during the lesson, tie research assistant also 
stopped the videotape to obtain the teacher's analysis of these 
segments . 

During the interview, teachers were told not to invent an 
analysis of intentions for students f cognitive responses when they 
had intended none during the lesson, The goal of the analysis was 
to obtain from the teacher as precise a description as possible 
about cognitive operations s/hc intended students to use in 
response to his or her teaching. Sometimes, the teacher provided 
this description without prompting or requests for clarification 
from the research assistant* When this was not the case, however, 
the research assistant probed the teacher in a manner such that 
analyses were solicited from the teacher rather than the research 
assistant asking the teacher to verify one or another 
speculation. Only after non-d i rec M ve probing proved insufficient 
did the research assistant request clarification in ways that 
directly structured the teacher's description of intentions for 
student cognitive processing* This procedure was used to reduce 
the chances that the researcher f s biases would influence the 
teacher's self^reports * We have no data, however, to support the 
validity of this procedure , nor do we have any data which 
indicates that research assistants selected the same types of 
incidents for teachers to comment upon. 

After a tcicher was interviewed, the research assistant and 
both principal investigators analyzed the videotape of the lesson 
and corresponding audiotape from the interview* The goal of these 
analyses was to create categories of intended cognitive responses 
that were unique to each teacher* ^he procedure was as follows* 
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Th« v i deotapr; was stopped at ooints where the teacher had 
indicated in the interview that s /he wanted che students to engage 
in certain cognitive operations in response to his/her teaching* 
At these points, the intended cognitive response(s) described in 
the interview were written down, interpreted, and clarified based 
on findings from the first vear's study. As these descriptions 
accumulated* preliminary category schemes were proposed and 
■ compared with previous and subsequent incidents within each 

lesson, These analyses were performed on each of the first three 
lessons on hearing in Mr, Forrester's and Mr* Dixon's classes. 
Because much of her teaching proved to be so similar across her 
three classes, we sampled only the first two of the four lessons 
on hearing in each of Mrs. Christy's classes (a total of six 
lessons) to reduce our demands on her time, These analyses 
produced an idiosyncratic n map l? of the intended cognitive 
responses each teacher sought to have students use when s/he cued 
students by delivering instructional stimuli during teaching. 

Following these analyses, tallies of each category of 
intended cognitive response were made along with annotations about 
their typical placement in lessons (e.g., in the introduction, 
after quest ion-and-answer sessions), Eight intended cognitive 
responses used very frequently by each teacher were common among 
all three teachers, Thus, these eight categories of intended 
cognitive responses were used to describe teaching for all three 
teachers^ although the frequency with which each teacher used 
specific intended congitive responses varied. These eight 
intended cognitive responses and the phrases we used to describe 
them to teachers are presented in Table 14. 

After generating this list of indended cognitive responses, 

each research assistant verified with their teacher that this list 

t 

accurately reflected the characteristics of their teaching in 
general, and that the specific instructional behaviors and 
cognitive operations they intended students to engage in response 
to these events were .paired correctly, Each teacher agreed with 
our proposed list . 
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TART.F 1 U 
Intended Co gn Ui vp Res pons es 



( 1 ^ Monitor Comprehension: 

Check to see if you understand, 
Hompare Codes: 

Think what 1 s the rriup about the term and a Hia^rRm, 
( 1} Retrieve i 

Try to remember something in particular, 
( l\ > Monitor Other fituHpnts f Answers: 

Listen careful 1 v to what the next students sav, 
(S^ Compare Attributes: 



Figure out what is the same and different about the 
two Ideas, 



( ft } Rehearse : 

Say this Idea once or twice in your ml nd ^ 
f7> Orient to Microscopic Elements: 

Pay close attention to the verv next thing, 
(8} Retrieve Attributes and Generalise: 



Remember the kev parts of an idea and use them to get 
an answer* 
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T'hp ^mjrch lesson in t^e unit on hearing was not used in the 
mapping phase, Tt was used to create aptitude teats that measured 
students ' accuracy of perceiving their teacher's instructional 
s timui i and i n tended cogni ti ve responses , These tests are 
described later In the section on Instruments. 

Generalized Intended Cognitive Response (ICR) , The eight 
common intended cognitive responses i dentifi ed by mapping the 
three teachers' instruction constituted too large a set to 
consider training students to execute all of them in response to 
eight distinct categories of Instructional stimuli that a teacher 
might use. The problems we faced , then, were those of balance and 
economv, On the one hand, there were practical constraints during 
the training phase of the study regarding time and students T 
abilities to learn intended cognitive responses. On the other 
hand, we wanted to train students to use a large number of the 
Intended cognitive responses their teacher cued in lessons so that 
their cognitive responses to teaching would be valid and would 
have an optimal chance to influence learning the ecology 
curricu"* urn, 

The solution adopted was to attempt to create a generalized 
intended cognitive response that had several properties First, 
it should be a composite of as manv as possible of the discrete 
Intended cognitive responses identified in Table 14 to maximize 
Its "content validity." Second, It should be theoretically 
applicable to several different forms of learning that would be 
tested by different types of Items on the obiect I ve arid essay 
achievement tests administered at the end of the ecology unit* 
This would increase its usefulness for students. Third, it should 
he amenable to being cued by a single instructional stimulus at 
qu^te different points in a lesson* This would reduce the demands 
placed on students and their teacher by requiring students to 
watch for only one instructional stimulus during lessons, and by 
requiring the teachers to work consciously at only one change In 
their teaching style, The need to minimize changes in the 
teacher's typical delivery also was necessary so that students not 
trained to use r.he generalized intended cognitive response would 
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not Find their teacher *s instruction subs. 



1 1 al 1 v al tared , 



thereby disrupting previously acquired cognitive activities for 
the comparison group during lessons. Fotirth, the Intended 
cognitive response needed to be structured so that students could 
provi de Ins true tl onal 1 y unobtrusive but observable ( wri t ten ) 
Indicators that thev had executed the appropriate cognitive 
operations on the correct currlcular Information, f.e*, produce a 
behavioral indicator of their cognitive responses to teaching. 

The generalized Intended co gn i 1 1 ve response we produced was a 
multi-step cognitive plan for processing Information* Each 
teacher signaled students to use this generalized intended 
cognitive response for important Information hy uttering a unique 
tag, the instructional stimulus, like "Make sure you ..." We 
label the pair formed by the teacner's instructional stimulus ^TS") 
and the students 1 intended cognitive response f TCfO an IS-TCR 
unit. Several paths through this p 1 an were possible, depending on 
the student's state of knowledge and whether the information had 
already been presented or would be presented shortly in the form 
of an answer to a teacher's question (Bern Figure 3). This 
cognitive plan incorporates all eight of the intended cognitive 
responses listed In Table 14 ? al though a single execution of an 
TS-TCR unit rarelv would involve all eight intended cognitive 
responses^ This generalized TR^TOE unit met the first three 
criteria we required of an intended cognitive response* 

To address the fourth criterion we demanded of an intended 
cognitive response, we sought to create a behavioral indicator of 
the generalized intended cognitive response* Four other criteria 
had to be met In creating this indicator. First, the behavioral 
indicator had to be simple so that students could learn it 
easily* Second, It had to require a small amount 4 of time for its 
production so as not to interfere with the rapid flow of 
instruction in the classroom* Third, it should require that a 
student engage in the intended cognitive response in order to 
produce a correct behavioral indicator, i*e., he dependent on the 
intended cognitive response* Fourth, the behavioral indicator had 
to reflect the various parts of the generalized Intended 
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COCHITIVI' RESPONSE AND BEHAVIORAL INDICATOR 



InatryC t iynal stimulus 
i£lteper=E or diagram 



compare Eodii 
eospsfe sttriouEei 
nhearie 



write 



csgprehension 
rehfar§e 



write 
sEaEfient 



eliiints 



record 

39UtCe Of 

eenf inaed 



Initruetional stimulus 
plus question 



iqrBpife code? 
ritrieye 

compare aE tributes 

orient to 

nicfSflcspic 

eitsinti 
retrieve attributei 

and generalise 



ufite 

preliminary 



ffipnirpf 

Eo&prehefiiisn 
loniEof other 

student! ' 
answers 
rehearse 



rewrite/ 

CSFfiCt 

preliiin- 



orient to 
microscopic 
elesiinti 



record 
ssufQi if 
eon firmed 
aniWerl 



Figurt 3* £sFreipondcn£e of Cognitive igipsnsff to Parts of EehsviOfal 
Indicator far Varying Initrycddnal Events 
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cognitive response so that it represented the several covert, 
cognitive activities students engaged in response to instructional 
stimuli. 

The behavioral indicator we designed to meet these 
requirements had three parts. Each part reflected the product of 
information processing corresponding to one step of the 
generalized intended cognitive response. The behavioral indicator 
for the first stage of the generalized intended cognitive response 
consisted of the student writing out a short .but meaningful 
phrase . The phrase either repeated the teacher's statement, was a 
verbal representation of a diagram on the chalkboard, or 
represented that student's preliminarv answer to the teacher's 
question, This observable act reflected intended cognitive 
responses noted in Table 14 in the following ways. Forming a 
preliminary answer to a teacher's question entailed the intended 
ive responses of orienting to microscopic elements of 
truetion to identify appropriate content, retrieval of 
attributes plus generalisation, or comparing attributes of 
concepts. The particular cognitive response depended on the kind 
of question the teacher had asked. Formulating a verbal 
expression about a diagram reflected the intended response of 
comparing codes. Writing a repetition of the teacher's question 
demands at least one rehearsal of chat information, 

To reflect the second stage of the generalised cognitive 
response* students also wrote a short phrase, It included 
information thev had confirmed as important and correct. This 
component of the behavioral indicator for the generalised intended 
cognitive response could reflect several of the simple intended 
cognitive responses listed in Table 14, When students judged the 
correctness of the information that they had in mind before 
writing it, they were monitoring comprehension, An even more 
valid indication of students monitoring their comprehension was 
obtained when, in the context of a teacher's question, the phrase 
they wrote corresponding to the second stage of the generalised 
intended cognitive response differed from that written for the 
first stage, This suggests they were checking the accuracy of 
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infarni.it inn rhov processed du -i n»> the lesson* As they wrote this 
information, it was rehearsed at least once* If the information 
being processed originated from another student, they had to 
monitor other students 1 answers before monitoring their 
comprehension and rehearsing, 

In order to obtain more general evidence about students * 
patterns of attention to sources of information, we included a 
third part in the behavioral indicator. This part required 
students to record the source confirming that information they had 
cogn^tively processed in the second stage of the generalized 
intended cognitive response was important and correct . This 
confirmation could originate from any one of three sources* their 
own, reasoning information that the teacher stressed verbally or 
highlighted on the chalkboard (e,g,, pointing at a part of a 
diagram, underlining a word)* or another student's response that 
the teacher acknowledged as correct, Operationally* students 
wrote a code indicating the source of information. The codes were 
M for me (i*e*s self was the source ) f T for teacher * B for the 
board, or S for another student, Thus, all eight of Che intended 
cognitive responses in Table 14 that comprised the generalized 
intended cognitive response were .reflected in one way or another 
in the three stages of the complete behavioral indicator* 
Training 

There were two purposes of training! to train students to 
use the generalised intended cognitive response when cued ^y their 
teacher's instructional stimulus, and to train them to provide 
behavioral indicators of the cognitive operations they carried out 
during lessons* For this latter purpose, students were provided 
with lined notebook paper that had been divided into three 

columns. The leftmost column was used to record the results of 

■ 

the first stage of the generalized intended cognitive responses, 
The rightmost column was the place for recording their responses 
representing the second stage of their cognitive processing, while 
the middle column was reserved for the codes (M, T, B, S) 
indicating the source to which they oriented to complete .this 
second stage* 
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A training program consisting of six sessions was designed to 
introduce students and their teacher, who also attended these 
sessions, to the nature of the IS-TOR units and how these units 
would be ooerat ional ized in the upcoming lessons on ecology, The 
first four training sessions followed a common format. Each began 
with the research assistant instructing students about features of 
the generalized intended cognitive response and the corresponding 
behavioral indicators. To begin the session, the research 
assistant described what wouj d be trained that day. Then, a pre- 
selected segment from the videotape of the preceding lesson on 
vision was shown* This was followed by the research assistant's 
description of how students were supposed to respond with the IS- 
ICR unit to that part of the lesson followed bv a description of 
the corresponding parts of the behavioral indicator, Students 
then attempted these cognitive and behavioral activities, and were 
given feedback. on their work bv the research assistant. Three or 
four more opportunities for practice and feedback followed, each 
based on a new segment of the videotaped lesson, These activities 
occupied about the first two-thirds of each training session. 

In the last third of the training session, the teacher 
retaught some of the material from the lesson that had been the 
basis for the preceding training activities, R/he practiced using 
the instructional stimulus and had an opportunity to observe the 
time students required to execute their mental and written 
tasks, Students practiced their instructional response during' 
these periods to improve, the skills they had worked on that day 
and in preceding training sessions. The research assistant 
provided corrective feedback to both the teacher and students 
about their performances, 

The last two training sessions included only live practice 
with the teacher and students, and thus followed the format of the 
last third of the first four sessions. More detailed description 
of each session is provided next. 

The first training period^hegan with the research assistant 
providing a general description of the nature and purposes of 
training, Students were told that what thev would learn in these 
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sessions should help tbr-m get higher marks on the achievement 
Cp. sts they would take on the vision unit and, subsequent ly f on the 
ecology unit. Next , the research assistant played the first 
segment of the videotaped lesson and identified the teacher's use 
of the instructional stimulus, All segments chosen for this first 
session illustrated a teacher's statement that implied an intended 
cognitive response. The research assistant described only the 
rehearsal component of the first stage of the generalised intended 
cognitive response by saying, "The teacher wants you to repeat 
that information several times in your mind," Then f the research 
assistant demonstrated on the board the first part of the 
behavioral indicator. 

Practice examples followed in which the research assistant 
first asked students to verbalize what the IS-ICR unit was, and 
then to write the behavioral indicator of their cognitive 
processing in the leftmost column of their worksheets- Feedback 
about what the students wrote down was provided to insure that the 
information was correct, and to help students learn how to write 
brief but accurate descriptions rather than long verbatim accounts 
of the information they had rehearsed* Then, the live practice 
plus feedback session followed, ° 

There were two objectives for the second training session. 
The first was to consolidate the training from the first 
session. The second objective was to introduce the second stage 
of the generalised Intended cognitive response and the part of the 
behavioral indicator associated with it. The session began with 
the research assistant reviewing the previous day's session. 
Several segments of the videotape from the second lesson on vision 
that contained teacher statements tagged with the instructional 
stimulus were then used to practice these skills. As in the first 
session, the research assistant provided students with feedback 
about their work. 

The research assistant then introduced students to procedures 
for using both the first and second stages of the generalized 
intended cognitive response when the teacher tagged a statement 
with the instructional stimulus. Specifically, they were told 
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chat, following the first stage of the intended cognitive 
response, they were to rehearse this information at least one more 
time and then write it in the rightmost column of the worksheet. 
Practice segments from the videotape followed* The second 



practice for students, supplemented with, feedback from the 
research ansistant. 

With the two stages of the generalized intended cognitive 
response and their respective behavioral indicators now introduced 
and practiced for teacher statements, in the third training 
.session, students moved on to extend the use of these skills to 
occasions where teachers tagged a question with the instructional 
stimulus. Using an example from the videotape of the lesson, 
students were told to: (1) try to answer the question, (2) write 
a brief answer, (3) seek confirmation of their answer^ (4)mentally 
revise the first answer if needed, (5^ check to he sure they 
understood the correct answer, (6) rehearse the correct answer 
several timeSj and (7) write out a brief version of the correct 
answer* For questions where students could not generate an answer 
"for the question (step 1 above) , they were instructed to draw a 
line in the leftmost column of their worksheet to indicate that 
they had noticed the instructional stimulus, and then proceed to 
the fifth step of this routine after seeking the correct answer to 
the question from another student or the teacher. A few practice 
plus feedback examples followed* 

The only aspect of the general i zed intended cognitive 
response remaining to he trained was for the student to indicate 
the source of the verified information that they had rehearsed and 
written on the worksheet, This also was an objective of the .third 
training session* Students observed a segment of that day T s 
videotaped lesson and received instruction from the research 
assistant regarding orientation either to their own cognitive" . 
responses $ the teacher, the chalkboard, or other Mude^iEs* 
answers. They also were taught to record the ebde(s) on their 
worksheets that identified the source of the verified information 
the*y had rehearsed and written as a* resul t .of stage two of the 



tra i m ng 



ion ended with the teacher providing some live 
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generalized intended cognitive response, A few further 
oppnrtun i t i o.s were provided to practice this new component in 
response to videotape examnl es , This training session ended with 
the teacher providing live practice for students plus feedback 
from the research assistant about the complete generalized 
intended cognitive responses and the corresponding behavioral 
indicators for both statements and questions, 

T he fifth and sixth training sessions provided the teacher 
and his/her students wi th further opportunities to engage in live 
practice and receive feedback from the research assistant* The 
objective of these sessions was to consolidate and bharpen the 
entire repertoire* The research assistant also concinuef! to help 
students frame brief statements for the first and secor A parts of 
the behavioral indicator so that they would not fall behind the 
flow of information and events in regular lessons* 
Ap t i t ud e Te s t 

The model from which this research is derived postulates 
chat* during instruction^ teachers intend students to manipulate 
information cognitivelv in particular ways* Teachers cue these 
intended cognitive responses with instructional stimuli, The 
intended cognitive response (ICR) aptitude test was developed to 
gauge the extent to which students accurately perceived their 
teacher's intended cognitive responses for pre— selected 
instructional stimuli. A videotape of lesson four in the hearing 
unit served as the source of instructional stimuli and 
corresponding intended cognitive responses* 

The ICR aptitude test was developed in several stages* Using 
the list of eight intended cognitive responses created by mapping 
the three teachers 1 instruction (see Table 14), we analyzed the 
fourth videotapes in each of the five classes to identify 
instances where an instructional stimulus cued intended cognitive 
responses. The goal sought in this analysis was to locate at 
least three salient illustrations in each lesson of each type of 
intended cognitive response from the list in Table 14, In total 
we identified 27* 23* 28* 31 ? and 32 such instances in each of the 
videotapes in the five classes A*-E* respectively* Following our 
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preliminary analysis, Che research aRsisEnnr met with the teacher 
to validate the instances we had chosen . To do this, the teacher 
viewed the segments of videotape we had isolated with the list of 
the eight common intended cognitive responses from Table 14 in 
hand. The teacher % s joh was to select from the list the type of 
cognitive response that s/he had intended to use in that segment 
of the lesson. 

The teacher's data from this validation, along with several, 
other criteria we imposed that are described shortlyf were the 
bases used to create a 20-item aptitude test for that class 1 
lesson, All instances where we and the teacher had agreed on the 
intended cognitive response were sorted into the eight categories 
of intended cognitive responses listed in Table 14, The first 
criterion imposed on these instances in selecting 20 for inclusion 
on the ICR aptitude test was that the entire test had to contain 
two or three instances from each of the eight categories so that 
there would be a relatively balanced distribution of the types of 
simple intended cognitive responses over the 2 5 = ^0 minutes of the 
videotape* Second, we chose instances in such a way that there 
were no long segments on the videotan^s I * e , , more than about 4 
minutes, that did not contain an instance, Third, the instances 
were chosen so that the curricular information in the segments of 
videotape was as we 11 -de ve 1 oped as possible. This decreased the 
chances that students 1 perception of intended cognitive responses 
would be influenced by weaknesses in their state of prior 
knowledge (see chapter 2), Fourth, all examples had to be of high 
technical quality, i*e* f audio and video aspects had to be easily 
comprehensible, Tf there were more than three examples for each 
type of intended cognitive response, we reviewed our selections to 
choose the segment of the videotape which, in our judgment , most 
clearly represented each type and which met the foregoing 
criteria* , . . 

Tf there were fewer than two selections from- a category of 
intended cognitive response, we reviewed the videotape to identify 
instances on which we and the teacher had disagreed in our 
original analyses, We then selected from among these instances 
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what was needed to complete the test in accordance with the 
fort-urn ni» criteria. Tn these few cases, ranging across the five 
classes from on 1 v 1 to 25 percent %f alt the instances that we had 
identified origins 1 1 v, we used the intended cognitive response 
that the teacher had seipcr^d as the "correct" intended cognitive 
response . 

Thn selected examples of TS-TCR units formed a unique 20-item 
f our^al ternative multiple-choice test for each class, The stem of 
each item consisted of a segment of the videotape illustrating an 
IS-TCR unit in the teacher's list and a corresponding paper-and- 
pencil question, e.g., "How did Mrs, Christy want you to think 
now?" The three distractors listed for an item on the student's 
test paper were Intended cognitve responses which corresponded to 
instructional stimuli other than the example portrayed on Che 
videotape, Thev were chosen under the constraints that they had 
to seem to be plausible* intended cognitive responses at that 
point, and that each intended cognitive response serve as a 
d i s tractor w.i th approximate 1 v equal frequency* The "correct" 
an s war was the intended cognitive response that we and the teacher 
had agreed on independently. Each intended cognitive response 
occurred as a d is tractor approximately three times, 

To administer the aptitude test, the research assistant 
showed the entire videotape of lesson four from the hearing unit 
to the students up tn the point of the 20th TS-TCR unit. During 
plavback, the videotape was stopped at those points which 
corresponded to a written item on the test. Each test item asked 
the students to indicte how they thought their teacher wanted them 
to be thinking at that point in the lesson* The videotape was 
restarted after all students had answered the item. The items 
contained in each of the apt itude ^tests are listed in Appendices 
F-^FU The number of items students answered correctly served as 
their score on the ICR aptitude test, 
Procedures for Scoring Notebooks 

Students' notebooks in both the comparison and the trained 
groups were scored for the content recorded in them that related 
either to objective test items or to material for which points 
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wt?re awarded in the essay i terns, For students in the trained 
groups, four tvpes of scores were crated. The first kind of 
score, called the behavioral indicator score, reflected the extent 
to which students' behavioral Indicators of their cognitive 
operations were complete. This score is conceptual 1 v similar to 
the behavioral indicator scores in Studies TT and ITT* varying 
onlv because the components of the intended cognitive response in 
this study differed from those of the earlier ones. Here a concept 
was identified for each test item on the objective test and for 
each point constituting the scheme for rcoring essay items. The 
students 1 behavioral indicators were awarded from zero to three 
points for each concept depending on the number of aspects of thj 
behavioral indicator that thev completed on the notebook pages we 
had constructed for them. Thus, for the ■ oh ] ec t i ve test on 
ecology, students in the trained group could get a maximum score 
of 12 (three points per complete behavioral indicator x 24 
obiective items), Separate behavioral indicator scores were 
generated for notes corresponding to items on the objective test 
and for notes corresponding to material that was awarded points in 
scoring the essay i terns , Students in comparison groups obviously 
could not receive a behavioral indicator score. 

The second kind of score concerning students 1 cognitive 
operations during teaching measured thp rxtenf to which students 
took notes of any sort pertaining to material covered in the test * 
items, This meant that any aspect o^ a student f s notes referring 
to content covered in a test item was given a score of one, This 
score was also computed for students in the comparison groups. 
Thus, for the notes corresponding to items on the ecology 
objective test, students in both the trained and the cotnapr i son 
groups could achieve a maxiumum raw score of 24, in order to 
allow comparison of this score with the behavioral indicator 
scores for students trained to make intended cognitive responses 
and provide behavioral ind i.Ljtors, this raw score was multiplied 
by three to place it on the same length scale as the behavioral 
indicator scores* This score, which awarded full credit for anv 
component of a behavioral indicator for students in the trained 
groups, was called the total notes score. 
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Tha third and the fourth kinds of scores characterizing 
trained .ind comparison group student? 1 notes taken during teaching 
reflected the extent to which they took notes about concepts that 
the teacher had tagged with an instructional stimulus, and about 
concepts which appeared on the test hut which were not tagged by 
teacher's instructional stimulus. These are called the tagged 
notes score and the non=tagged notes score , respectively* In 
order to make these easily comparable to the foregoing scores, the 
sum of these two scores was fixed to place it on a scale with a 
length of zero to 72. Thus, the tagged notes score can he 
compared to the behavioral indicator score and to the total notes 
score hv forming a ratio of the former to one or the other of the 
latter. The same tvpe of comparison can be made for the non- 
tagged notes score* Also, the sura of the tagged and non-tagged 
notes scores equals the total notes scores. In the case of class 
A, the maximum score for the tagged notes scale was 54. The non- 
tagged notes scale had a maximum of 18 for this class. In the 
other four classes, the number of items on the objective test were 
equally divided between those tagged by teacher's instructional 
stimulus and those not tagged. Thus, the raw score maxima for 
these other classes were 36 and 36 s respectively (12 items times 
three)* 

Scores for concepts recorded in students' notebooks 
corresponding to information that was awarded points when scoring 
the essay items varied from class to class* In class A* the 
maximum essay score was 72* In class B, it was 63. In classes C> 
D, and E, this maximum score was 38* 
Achievement Tests 

Because there was only general consensus among teachers as to 
the information that would be covered in each of the three 
curriculum units, teachers varied in the concepts and principles 
they taught* The research assistants met with their teachers to 
write items for the achievement tests for all three units prior to 
the beginning of instruction on each unit* These tests, comprised 

of objective items (mul t i pi e-choi ca * matching, fill-in) and short 

i. 

essay sections, were then reviewed and refined by the entire 
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research staff and then again hv the teacher. Kach test item was 
linked to one or 'more specific concepts in a lesson (see 
Appendices F, 0, and H), 

In order to assure content validitv of the test items, the 
research assistant reviewed the videotapes find the notes taken 
during the lessons. Tf the information needed to answer an item 
was not covered, it was stricken From the test and a new item was 
generated covering content that had been taugh t , Prior to 
administering the achievement tests to students, all test items 
were checked a final time by the teacher for clarity and content 
va 1 id it y , 

The, test for the hearing unit contained two essay items, and 
the tests for vision and ecology units each had three essays, 
Total essay score values across teachers ranged from 14 to 23 for 
hearing, 24 to 27 for vision and 21 to 23 for ecology* On the 
objective part of the achievement test, there were 12 items for 
hearing, 1 ^ items for vision, and 24 items for ecology* Scores on 
the essay and mul tiple-^choice tests covering the unit on vision 
are not used in analyses* These tests were included both for the 
teachers * purposes of assigning grades, and to acquaint students 
further with the nature of achievement measures they would 
experience at the end of the ecology unit. We also reasoned that 
these achievement scores could not tell much about students 1 
'learning vis a vis the cognitive mediational model because 
students in the trained group were in the process of altering 
their cognitive responses to teaching. 

The achievement tests were created hv sampling content from 
each of the lessons within a unit roughlv equally. This criterion 
was only partially achieved because of a number o f constraints* 
First, for the vision test, the number of items we sought was not 
divisible equally by the number of lessons that had been taught. 
This required us to include fewer items on the test from some 
lessons. Second, each lesson taught by the three teachers did not 
contain equivalent amounts of information, Some lessons contained 
more concepts and facts than did other lessons. Thus, a strict 
application of the equivalent item sampling criterion would have 



rt*f|uirtMl resting concepts and facts chat were of minor importance 
because a particular lesson was conceptually and Factually lean. 
Third, in same instances a teacher misrepresented the meaning of 
kev information due to incomplete knowledge. We decided not to 
test students for information that they had been taught that was 
not factual Iv correct. Thus , for some lessons , the pool of 
available content from which f terns could he sampled was reduced 
further. Fourth f on the ecology test , we wanted to distribute 
items on the tt;st over both tagged information (i,e, ? information 
the teacher had tagged with the instructional stimulus) and 
untagged information (i,e,, information not tagged with the 
instructional stimulus). The complete specifications for all of 
the achievement tests for the five classes can be found in 
Appendices F f n, and H. 

All questions on hoth the essay and objective parts of the 
achievement tests were randomly ordered. For all tests, the essay 
items were completed before the objective part* There were four 
possible responses in multiple-choice questions which were 
randomly ordered with the proviso that there were an approximtely 
equal number of correct responses in any given position* 

Scoring manuals were created (see Appendices F=H) to score 
the essays, points were assigned according to the degree of 
correspondence between a student's response and the criteria 
established as acceptable in the manual. Each research assistant 
marked all the tests for the students in his/her assigned classes, 

RESULTS AND DISCUSSION 
For all of the analyses reported in this section^ the 
original sizes of the training and - compar i son groups were reduced 
to the levels as show in Table 15* Criteria used to make these 
reductions in sample sixes were as follows: Students could not he 
absent for more than one of the lessons in the hearing unit or the 
ecology unitj and h,. I to he present for the TOR aptitude test, the 
objective and the essay tests on the hearing lessons f and the 
objective and the essay tests about ecology, tn addition^ 
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Ht n«li»nts in the grained groups had to be present for at lease four 
of Che six training sessions* Thus, in classes A, B* and E, 
students were allowed to mi « two of the training sessions and 
still be included in the experiment provided that they met the 
preceding criteria, In classes C and D , where one training 
session of the six planned sessions had to be cancelled due to 
problems in schedulinK, students had to be present for four of the 
five training sessions. These criteria ensured that students had 
an opportunity to learn tho material presented in the lessons, and 
that there were scores available for them on the ICR aptitude test 
and prior achievement tests on the hearing unit that could serve 
as predictors in backward selection regressions analyses. 

For at least one variable in each of the five classes, it was 
computationally impossible to produce internal consistency 
estimates of reliability Hue to problems of indetermina 
Moreover, some of the remaining estimates of reliability were less 
than classical test theory allows when judged against the 
correlations between variables, i,e, 5 squared correlations 
exceeded the reliability coefficient for one or both variables* 
We conclude from these conditions that many variables measured in 
these classrooms were not internally consistent (heterogeneous; 
Cronbach alpha ranged from .05 to ,79; Md = ,60) and that the 
smal 1 sample sizes per classroom exacerbated this situation. 
Therefore^ we have not reported reliability coefficients for 
variables in this section. However ? on the basis of both 
correlations among variables and the regression analyses presented 
later in this section, we do not judge uiat the data" is 
unreliable. Rather, we take the view that real teaching 
situations in the classrooms where we worked produced variables 
for which internal consistency estimates of reliability are 
inappropriate . 

Can Students Be Trained to Make Intended Cognitive Responses ? 

Table 16 provides mnans, standard deviations, and t-tests 
among m^ans for the trained and comparison groups in all five 
classes on the scores derived from their notebooks, Only for the 
essay^related scores for Class R were there statistically reliable 



TABLE 16 



Heiins, St gnd^rd DtvUtfoni, and t'Teitt far %t&t?i ffda Notebook! 



Test 

f7?> 
(Ml 



, = i ,r. 



VM 



Total Notrs 



17. so 2 u,n 

11. 55 15,05 

20,40 4,41 

?i.7i 10.53 



24.38 

10,00 

7.n 



4J, 10 
v- , 50 

11.20 

76, so 

if. 55 

43, «« 

is, on 

41 .61 



17 . 16 
1ft. 41 



6,70 
7,0! 



,62 



-.93 



20,87 -.61 
U. 17 

ft, OR 05* 

7,52 

15. 50 ,5) 

70,21 

9.10 
IS. 33 

11.31 
8,48 



,77 



9 s 



4,45 l.if 
5.6ft 



41. "1 «, Si , s ] 
40.01 9. 68 



.IS 



TagRpd Hot M 



24.90 

22,91 

14.10 

17,73 

12,00 
15,43 

1,00 
4,00 

17,40 
16,00 

12,60 
8,50 

, : ; 

25,88 

1ft. 00 
12, $1 

19,1ft 
IB, 71 

13,91 
15,88 



9 .80 
11.41 



,43 



3,18 =1,34 

7 OQ 



10.52 

6,58 



.74 



1.41 =4,67* 

1.00 



8,34 

Mi 



,31 



2,15 2,10* 



1 7 



71 



4.' 1 ,M 

3.7V 



4,45 1.4ft 



t>M ,54 
5.58 



S,M 

4,11 



Kgn*tagged Hotes 



Behavioral Indl eafor 



sd 



.3 



12.60 4,88 L00 30.10 15,58 3,60* 

10,64 4,H 

6.30 2, 21 ,23 15.00 6,45 2,58* 

6,00 3.55 



17.18 10,81 
14.5? 6,35 



.47 21.75 20.62 7.54* 



6,13 5.82 -1.69* 
18.29 6,90 



5,63 5,9] l,9st 



23,70 9.21 

20.50 11,13 

18,50 3,41 

18,00 8, 



.67 31,30 11,74 5.37* 



.16 16.80 6,83 M3» 



21,87 7.9S ],fi9 75,18 13,75 9/'S* 
18,00 6,9? 



9,00 0,00 0, 
9.00 0,00 



24,55 
23,71 



5,66 
5.10 



19,73 5,66 n,98* 



25.64 10,47 7.25* 



M 23. 



2,9' 1.51 17.87 7.44 1 2,06* 
5.75 



Thf flit!""?! lf)\i\ ] nolr" 7 ; s r n f On 



the pM-tMvp Urn} 1 ? was the firifsr fn classes, 72, 



^ Upper f I fi if r=n ,i r r fo r thv trn'rifd efniip; Ifiypf figure are for Efa 5 f ffliMrf ?ion grniip, 

' This f-t^f rfvs^ps t^r HeKivJoral fnHlratnf svnTZ t$ thp total not ^ score wttMfl the trained gfOUPi 

' Kiehefs !n fvirenf ,m f aaxlniss lot a! rtotep irofel* 
* p i ,M 

ERIC 



In n 
00 



di t'!.>r.-nt-'»<4 Si-tw^en the trained and comparison groups in their 
notetaking during ] "^ons. Tn this single instance, students in 
the comparison grouo took more notes relating to concepts 
nonparing tMt itpnis than did students in the trained groups, 
Thus, to the extent that students' notes indicate that some kind 
of cognitive processing of test-related information is taking 
place, there were no differences in Che overall levels of 
cognitive processing exhibited by students in the trained groups 
and those in the comparison groups, with the exception of class B, 
Also provided in Table 16 is a wi thin-group comparison of the 
scores earned h v students in the trained groups on the behavioral 
indicator score and the total notes score for concepts appearing 
MT1 the objective and on the essay tests, tn every case, students 1 
total note- scores exceeded (p < .10) their behavioral indicator 
scores at statistical Iv reliable levels. Thus, while students in 
the trained groups generally did not differ from their untrained 
counterparts on the number of occasions in which they engaged 
cognitions regarding curriculum content to* he tested, their notes 
revealed that not all of these occasions completely reflected the 
three-stage generalized intended cognitive response they had been 
taught. Whether this difference indicates that students in the 
trained groups had internalized more of the intended cognitive 
response, thereby making the behavioral indicators .perhaps seem 
less necessarv to them, or whether some aspects of the generalized 
intended cognitive response were not carried out cannot be 
determined from these data, All that can be said is that there 
are some statistically reliable differences in trained students 1 
execution of the generalized intended cognitive response fpr 
concepts appearing on the tests when compared "to their total notes 
scores, * . 



One wav to measure the extent to which these differences 
occur is to calculate effect sizes. These effect sizes, 
calculated by subtracting the mean of the behavioral indicator 
score from the mean of the total notes score and dividing by the 
standard deviation of the total notes scores were as follows* in 
class A, ,47 for the objective test concepts and 1,21 for essay 
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concepts- in class B, .11 for the oMeeMve concepts and ,21 for 
the essay concepts: in class C, .63 for the objective concepts and 
1,54 for the essav concepts: in class n, 2,06 for the objective 
concepts and 5,67 for the essay concepts* and in class F|, 2,15 for 
the objective concepts and 2.15 for the e s s a y concepts. Thus, 
with the exception of class H, there were fairly substantial 
differences in the extent to which trained students provided full 
behavioral indicators for the generalised intended cognitive 
responses they carried out corresponding to information that 
appeared on the tests, 

Another feature of the data reported in Table 16 that 
warrants mention is the relatively large variance in several of 
the distributions of scores, Examination of frequency counts for 
scores revealed that the distributions of these scores were 
occasionally extremely skewed, with some students taking 
absolutely no notes whatsoever and other students taking 
relatively massive amounts of notes. Thus, even in the trained 
groups, there was wide variation f n the extent to which the 
teacher influenced students to eognltively process information 
that appeared on the test* The fact that the trained students did 
not generally differ from comparison students in the number of 
notes they took on concepts that the teacher had tagged with an 
ins true tiona 1 stimulus might be interpreted to indicate that 
students in the trained groups missed manv opportunities to engage 
in the generalized intended cognitive response that they had been 
trained to use* It also could be interpreted, however, to reflect 
the demanding pace of regular classroom instruction which might 
prevent students from providing complete indications of all the 
.cognitive processing they undertook, tn particular* it might be 
that students do not take notes on all concepts that are tagged, 
but take notes only on those concepts that they believe are 
particularly difficult or that warrant an "extra" amount of 
cognitive processing. As well, these data might indicate that we 
have still not overcome the methodological problems created by the 
use of behavioral indicators of cognitive processing, That is, 
the behavioral indicator mav he interfering with the students' 
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eo*»n i t « vt j roHponHOH. Tn the face of conflicting demands regarding 
whether thev should complete the behavioral indicator or continue 
to execute the cognitive strategv ? students mav have chosen, the 
latter over the former. 

Overall, then, it can he said that students in the trained 
groups and the comparison groups took roughly the same quantity of 
notes pertaining to information that appeared on the tests. Thus, 
any differences that are observed on test scores cannot he 
attributed to the quantity of notes that were taken. Instead, 
differences in achievement scores must reflect qualitative 
features of, the cognitive operations that the students undertook 
and reflected in the notes that recorded aspects of these 
cognitive operations during teaching* 

How D o Intended Cognitive Responses Relate to Achievement ? 

To explore relationships between students 1 cognitive ' 
processing of content that would appear on tests and their test 
scores, correlations between the various scores derived from 
students' notebooks and achievement tests were computed, These 
are reported in Table 17 for each of the five classes, As can be 
seen in "T'abl e 17, there is wi^e .variation in the degree to which 
students* quantity of notes is associated with their 
achievement* While statistical tests of these correlations are 
hampered due to the small sample sizes, with only several 
exceptions* the general finding is that students 1 notetaking* and 
by inference, their cognitive processing of information during 
teaching, is positively associated with their achievement. This 
seems particularly true for students who were trained to make 
generalized intended cognitive responses and provide behavioral 
indication when the objective tests served as the measure of 
achievement, Tn the^e cases* the median correlation was *48, 
vr 'r-p-ns it was onlv * 23. when essay tests served as the measure of 
achievement. This pattern was reversed for the students who 
participated in the comparison groups*,. For those groups, the 
median correlation between quantity of notes and achievement on 
the objective test items was only »23, while the comparable median 
correlation for the essay test items was *42, 
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Do Intended Cognitive Responses Enhance Learni ng from Instruction? 

To test the relative influence that training students to make 
intended cognitive -responses had on their achievement, comparisons 
were made to their untrained counterparts, The method of analysis 
here paralleled that for Studies II and III. In particular, 
backward selection, mul ti pie-regression procedures employing four 
major categories of predictor variables were applied to the 
data. The first category consisted of aptitudes*! students 1 ICR 
aptitude test scores, their scores on a prior measure of 
achievement based on objective items from tests, on the hearing 
lessons, and their scores oh essay measures of achievement based 
x on the hearing lessons, The second major category of variables 
included a measure of students 1 ^notetoking during lessons that 
corresponded to the dependent variable, i.e., tagged objective 
items, non-tagged objective items, tagged essay items, and norv= 
tagged essay items). For instance, when tagged objective items 
was the dependent variable, the tagged notes score was used as the 
measure of classroom process from among the various notetaking 
scores that were described previously* The third major category 
waa^a single variable consisting of an effects co^4d vector 
comparing the trained (+1) versus the comparison group (=1) of 
students* The fourth major category of variables included seven 
interaction terms* One was a notetaking by treatment interaction, 
using the notetaking score that was matched to the particular 
dependent variable, as in the second category of predictors 
described previously, Three were formed by multiplying the three 
aptitude test scores from the first category of predictors by the 

i 

treatment contrast vector* The remaining three were three-way 
interactions representing the product of aptitude k notetaking x 
treatment. 

Descriptive statistics and the results of backward regression 
analyses, are reported in Tables IS through 32. .The results are* 
described fjirst in terms of each of the five classes 1 
.individually. An integration of the results across the five 
classes is then presented and reflected in Table 33," 
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A Statistical Note e ■ 

Before presenting the results , three aspects of these 
analyses warrant some elaboration so that the* information and 
statistics to be presented later can be ui^eratood more easily. 
The first item to be addressed is the method for interpreting a 
multiple regression ' equation* that contains two or more terms 
involving either a contrast between the experimental and 
comparison groups ? _ aptitude-treatment interac ti ons ? notetaking= 
treatment interactions, or all these types of predictors. A 
second issue that is discussed pertains to interpreting aptitude- 
notetaking x treatment interactions* The third item relates to 
the fact that only one measure of effect sAze can be reported per 
analysis even though two or more terms involving the contrast 
^between the trained and comparison groups mav appear in the 
results of an analysis. ,3 

Often a multiple regression analysis reported in the 
following sections contains several predictors involving the 
contrast between the trained and the comparison groups. To tafce a 
general izable* case , suppose that the analysis of the total 
objective scale (¥) had retained these termss ICR Aptitude (X 1 ^ J 
Group CX 2 ) f ICR Aptitude x Group (X^) , and Prior Objective 
Achievement x Group (X^) , plus a constant^ term (C) corresponding 
to the intercept. The multiple-predictor regression equation for 
this fictitious illustration could he* written symbolically like 
this: ^ 

(1) V * G + b 1 X 1 + b 2 X 2 + b 3 X 3 * b^X 4 

To explain how individual terms in this equation can be 
Interpreted (keeping in mind the caveat in footnote 1 9 p» 106), it 
is advantageous to write equation (1) in a nov*?l format, replacing 
the mathematical X_*,wi,th the^words describing the predictors to 
which they refer and labeling ; ach term in the equation- T he 
rewritten version of the fictitious example would look like this* # * 



(2) Predicted Total Objective Scale ■ Constant (a) 

+ b x (ICR Aptitude) (b) 

+ b 2 (Group) ' (c)« 

+ • b^ (ICR Aptitude x Group) (d) 

+ 1 b, (Prior Objective Achievement x Group) (e) 



The principle that is applied Co interpret any one* predictor is to 
rewrite the equation to create two groups of predictors* One of 
these groups will he made of all the terms in the equation that 

include the predictor that is going to^ be interpreted* For \^ 
examhle, to interpret the effect of ICR Aptitude, terms iKand d. 
are grouped together i ' ' ' 

(3) , b ^ (ICR Aptitude) -b 3 (ICR Aptitude x Group)* 
This grouping of terms can be rewritten Niike this: 

. (4) £h\ + b 3 (proup)^l ICR Aptitude 
because the predictor ICR. Altitude was included in both of the 
original terms labeled b and d in equation f2), Now, when the 
code assigned to a- particular group, either +1 for the trained 
.group or -1, for t^ie comparison group, is substituted into 
expression 4 for the word * 'Group," and when the numerical valuefs 
of the partial raw regression coefficients are substituted for 
and b^, % single numerical value for the terms in the brackets of* 
expression (4)" can be calculated* This single value is* the 
partial raw regression "". eoe * ficient for the predictor ICR Aptitude' 

. ' that, is assorted with the group whose code was substituted in 

the calculations* Hence* there are two regression coefficients , 
produced by doing these guffes.ti tut ions twice, one for the trained 
group when +1 is substituted for .Group* arid another f 6r the 
comparison group when -»! is substituted for G^roup. Now t we turn 
to the second collection terras mentioned in the principle 

* stated .earlier, ■ 

All of the remaining terms in equation (2), labeled a, c, and 
e'in that equation, are adrf^i together to form the second group of 
predictors referred r.o ear Zier? 

(5) Constant + h^CGroui^O + (Prior Objective Achievement x 

group) . 

If we combine expressions < A) andt5)» they look like thial 

(6) Y 1 * [Constant + b^< Group) * Prior Objective Achievement 
x Group) 3 + * [b 2 * fc 3 <Group)J ICR Aptitude* 

When it is ; noticed that vsL^ues can be substituted for every one of 
the terms found within brackets , simply adding up these values to 
get one number makes this -expression look suspiciously like a t * 
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simple regression ©qua t ten. involves only Qine predictor, ICR 
Aptitude; .one regression coefficient, the teritf 

[h^ * b^OOroupl J * and a constant tnac i& made - xip several items 
added together, name I y the terms in eMpressinn 5. The question 
that remains to be answered is how to . choope Vn lues for these 
terms to' produce one numerical value for. the ce rm that i s the 
regression coefficient, and one *for the term ch^C is the constant. 

Consider the term for the regression coe f f — -Leient first, f 
Numerical values for and b 3 mb part of the -nresul ts provided 
diredtly by the original 1 multiple regression sn^^lysis s - There 4 are " 
two numerical values for the word tf Group"; 4-1 md -1, Thus, 
looking at [b^ + bg (Group) J ^en j s syhsEit«j£ed f or Group! Che. 
numerical vajues for b^ and b^are Also substitiraaped * and the ! 
arithmetic of roul tiplying by +1 and adding tlHne result to hj is 
done, the end result Ms a regresaiori aoeffi eienis^ for the trailing 
group. Repeating the procedure but msbsfcf tutin^s = 1 for tje word 
"Group" produces a second regression eoeffieienst for the 
comparison group. Thus?, there are really two d —efferent regression 
coef f icients f one _for each of the two groups s yt^a bolized by the 
word "Group" in equation (6), 

TOrning to the coll action 'of terms inside ^aihe hraeke-ts s 
representing the constant (i. e S| expression 5) f the word "Group 1 ? 
can be !repX need by its codej i»e M ■+ 1 for thff tora ined group -or -1 
for the comparison group depending, on which grotspjp %M are^ working 
with for the moraent. Since we arB t now\ : deg£ri bi^mg a complita group' 
of students, it seems reasonable to replace the words "Prior 
Objective Achievement" with a 8t§ti3tic that de^serfbes the group 

1 ! 

being considered* The number ehoien for this su-obsticution is a f-. M 

. ■ . ■ " ■ • ■ 

group's mean on Prior Objective Ach ieveraent - Nesxt,* substituting 
the values produced by the multiple regression ^srialysis for 
Constant , .bj* and b^ ¥ and doing the arithmetic ^yields a single 
numerical value* This value is the intarJept for the group 
whose eojje'was substituted for the word "Group" and whose ^ mean 
score was substituted for Prior Objective Achie^^^ement, Thus, 
there "will be two y— intercepts I one; for the t trained group and ! 
another for the comparison group* < 
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The overall result of chase operations is to produce two * „ 
separate regression ^qisjations. One predicts Total Objective 
scores for students i% the* trained group* The other •predicts % 
these scores for stude«mts in the comparison group. Each, 
regression equation ha =^3 a simple form, namely: § • 

' (7} y 1, - c +bx " . ; . : -\ 

Because the regression '^equations for each group have different 
regression coefficient^^, these two equations describe an aptitude^ 
treatment interaction. Following the same procedures as just * 
outlined^ the aptitude— — treatment interaction involving Prior r 
Objective Achievement ^»lso^could be described as two simple 
regression equations. In general, any predictor can be described 
similarly by followtrjR this procedure. 

> The next aspect 0 ^fj * the multiple regr ^sion* analyses that \ 
needs explanation is h-*ov to. interpret aptiivude^apti tude-treatment 
interactions or apt*" tn —de-note taking- treatment interactions* In 
general, the same pfpe -edure as was just described is applied to 
these more complicated terms* except that one more step is 4 
needed. Using' the %amm example as before (see equations 1 and 2) f 
we add on one more tg i m involving an aptitude-notetaking treatment 
interction Cx^) where the notetaking variable is the Total Notes 
score on objective itwas. This produces parallels to equations 
(l) t and (2) that look like this: ? , 

(8) Y f = C + b'jXj + b^K 2 * b 3 X 3 + b 4 K 4 + b 5 X 5 ^ 

arid 

(9) Predicted fotfc.1 Objective Score = Constant (a) 
■ + b l (ICR AptL^tude) 

+ b 2 (Group) (c) 
+ b 3 (ICR AptE^tude x Group) (d) 
+ (prior Objective Achievement x Grqyp) - (e) 

+ (Prior Objective Achievement x 0 Total Notes x Group) (f ) 
Applying the pt-ir^aciple of regrouping to the predictor Prior 

Objective Achievement^ the 1 following two groups of terms are ^ 

created : m * 

' (10) Constant + ^CT ICR Aptitude) + b 2 (Group) * b 3 (l£R Aptitude 
x Group v _ , ' . . f . „ 

and - • 
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(11) b^CPriijr Ob \& I J :/f Achievement* x G^oup) x bj^Prior 
- Objective Vt: ? " <JW'\f: x Total 'Notes k .Group) * 
The *tertns in o^p s -ssi^n \> .») ian be rearrar^gedL to isolate Prior 

Objective Ac "h i jv^ *r ■ .k* US'! , - ' " 

.* \ (12^ [b^( ' u, ) i itfl ! : fotes K Group^ ( Prior^ Objective 

As be > f>- ; - subst " - it; . . the codes for either the training 
group 1 or ?Ai|»sr Isen ?*" rc-ip n expression 10 ^ and substituting the " 
dorraspo^df w >Qp?n sc: or for each group's HCR Aptitude Test 
produces h y xtr.er'- t for each group. . Th^=* same procedure applied 
to* the T/iar >NXe .i&me i in expression 12 produces a unique 
regression cc -I icient for each of the grot^aps* Putting these two 
results t-ogr 7 T r velds one simple regressSLon equation for each 
group tha/r ^scr^es, the relationship b^t^ean^a student's 
predicted ^fetal Objective Score and his or her Prior Objective 
Achievement score* • 

There is one elaboxratt en of thi § prGc^adure that now needs to 
be pointed out. Each time a numerical valine was substituted for a 
predictor that was a continuous variahl e f ^uch as the Total Notes 
see're, the value chosen for substitution the group's mean § ~ • 

score. However, this particular choice is not the only value that 
cpuld be used. For instance, a aeore equa H to the group mean pi us 
one standard deviation, might J)i used inste^ad, If this alternative 
vaJLue for the Total Notes score, were substituted in expression 11, 
a different^ number would be created for th^^ group's regression 
coefficient. In other words, within a sirig^le group of students, 
say the trained, group, 1 there is a different slope relating the 
predicted dependent variable, Total Objective Scores, and the 
aptitude, Prior Objective -Achievement , for every score that can be 
recorded for the notetaking variable, Tota^L Notes . Thus, the 

relationship between predicted Total Oh iec «ii ve Scores arid* 

' ... 

students' Prior Objective Achievement ehan^ges as scores on Total 
Notes change, * * ; 

'Conceptually, this is what interae tioisn means* When there is 
a "simple" aptitude- treatment interaction, the slope relating a 
predicted dependent variable to the aptsitu^3e "is^ different tn each 
group, * That was exactly "the point develop^Bd eartier when it was 
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explained how aptitude- treatment interaction terms that were 

embedded in' complicated regression equations cpuld be interpreted 

by* simpl i f ying the original regression results* Here, this mam 

idea of relations that change as one considers different groups is 

# ... 
extended tti terms in a regression equation, like on aptitude*- 

note taking- treatment interaction, where part of the interaction is 

a -continuous variable rather "than, a code for a group. Now, riot 

i . 

only does 'the slope relating a predicted dependent variable to an 
aptitude change^ depending on which group is being considered, but 
this sloge also changes within the group of students as their 
scores change on "the notetaking variable change* Although it is a 
long sentence to read, the "statement ' that captures this idea |a; 
When there is an apti tude-note taking- treatment Interaction, the 
relationship between students* aptitude and the predicted ' 
dependent variable changes as one considers different groups * and 
within a group of students* the rel atiort^between students * 
aptitude and the predicted dependent variable changes as one 
considers different scores on the notetaking variable* Thus f to 
fully appreciate the nature of an apt i tude-notetaking-treatmcni: 
interaction, more than one substitution needs to be made for the 
value of the notetaking variable so that changes in the 
relationship between the aptitude and the dependent variable can 
be displayed* * 

Before going on , a further question should be answered : Will 
there also be different y-intercepts for different values of a * 
notetaking variable? It depends on the composite that forms the 
y-intercept . In the example being used here (see expression 10), 
the variable Prior Objective Achievement is not included in the 
composite that forms the y-intercept „ So,, in this esse* the y- * 
intercept wil 1 not change because there are no different values of 
Prior Objective Achievement to be substituted in the composite 
that forms the constant, However, it is possible for the 
composite that forms the y-i ntercept 'to include a variable tliflt is 
also included in the second group of terms that produces the 
regression coefficient* When this is the case, there im a 
different y-intercept corresponding to each different value of the 
regression coefficient* 
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There are no well-accepted guide 1 ines for choosing the number 

of different regression coefficients, and* poss'i bl y their ' ' 

§ 

corresponding y-intercepts , that one needs to examine complex 
interactions fruitfully. Tn the analyses reported here, these 
complex interactions include apti tudp-notetaki ng-treatment 
interactions or apt itude-aptitude- treatment interactions. Some 
researchers (e.g. , Peterson, 1977} produce three-dimensional 
graphs of such interactions , thereby avoiding the issue of how 
many values to choose by displaying an infinite range *of such 
coefficients* We find' these figures useful, providing that the 
reader can interpret them, An alternative, illustrated by Cohen 
and Cohen (1975, section 8.4) , is to produce regression equations, 
for each' group at three points along the scale of the "extra" 
interacting variable (the notetaking variables in the previous 
example)! the mean minus one standard deviation* the mean, and- 
the mean plus one standard deviation, We have followed this 
latter course in this report* judging it easier to present and to 
interpret, Our choice also seems more defensible in the light of 
small sample siges for which an infinite range of coefficients 
might suggest a smooth change where such relationships may not be 
justified by our data. A disadvantage of our choice* however, is 
that standard deviations are sensitive to outliers* although the 
presence of outliers would distort three-dimensional graphs as 
well. Further, one should not discard outliers from a data. set ' 
unless it can be determined that the out! iers^* represent a 
different population than the scores constituting the remainder ot 
.the distribution* We assume here that s outl iers simply reflect the 
absence of intermedi ate values due to small samples* Thus, when 
we describe apti tude^aptitude— treatment interactions or aptitude- 
note taking- treatment interactions, we present tables describing 
within^group regression slopes and intercepts at these tjiree 
points of the scale for the interacting variable* 

The final issue to be explained before turning to the results 
is why only one effect siie statistic is reported per analysis , = * 
It may seem intuitive that an effect size describing differences 
between group means could be reported for every term in the 
regression analyses that includes tfhe group code* For example, in 
f # ' ' 
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expression 9, it may appear reasonable that four effect sizes 
could he calculated, one. for each of the terms labeled c f d, e f 
and f; The reason that this is not possible is given by the fame 
principle for regrouping terms as has been demonstrated 
previously* When , in expression 9 f terms .labeled a * and h are 
grouped to form a constant, and terms labeled c through fare 
collected to create a regression coefficient ? there is only one 
equat 1 ojrj^fo describe the predictor Group, namelyt 

(13) Predicted ^ptal Objective Score = 
[Constant + b { (ICR Aptitude)^ 

+ pb^ + ICR Aptitude ^ + b^ (Prior Objective Achievement) 
# b^(Prior ' Objec r ' ve Achievement x Total Notes )j Group. 
Substituting group means for the aptitude and notetaking 
variables, and a code for the Group produces only one predicted 
mean score per group. Hence , only one effect size can be computed 
comparing the two groups, calculated asi 

(14) E * CY' T - r c ) / MS rasidufll 

Regardless how the terms in expression -9 are arranged, for example 
as in expressions 10 plus 11, they can always be rearranged to 
give expression 13 , In other words," when there are only* two 
groups^ there can be only one effect si^e when group, means are 
substituted for continuous variables contained in the regression 
equation. This differs from the results of Study III, where the 
four vectors "representing contrasts among five groups were all 
free to remain in any particular regression equation, In that 
case, one separate effect si^e could be calculated for each 
contrast* But when a particular contrast was also invol ved' in % an 
apt it ude- treatment interaction, only one effect size was ' 
calculated for both the contrast main effect and the aptitude- 
treatment interaction, With these statistical e xpl ana ti cm behi nd 
us, we turn now to the results-. ■ 
* Class A • * . 

Descriptive statistics for the dependent variables in Class A 
are reported in Table 18. Differential effects on students' 
achievement due to the treatment were observed for every dependent 
variable except Non-Tagged Objective Itejns. Although these 
effects were statistically reliable, the effect size statistics 

eft' 
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suggest that educationally important differences ware not .found 

(see Table 19), In particulars on .the Total Objective Scale, v 

students 1 achievement in the* trained group corresponded only to 

the , 53rd percentile relative to the average student in the"" , 

comparison group. On the other dependent variables, differences 

in these relative t^rms were indistinguishable- However* these*' 

omnibus contrasts require qualification on the^basis of the 

interactions that were common among these analyses* Table- 20 

shows the calculations for these interactions as described in the 

previous section* ' ■ , 

The interaction involving Tagged Objective items as the 

dependent variable provides an exarapVe of the complex results of , 

training students to uae cognitive strategies in regular classroom 

lessons, Considei^ the interaction using notetaking (%2 *n Table 

20) as a grouping variable rather than ICR aptitude* 5 Either set of 

equations in Table 20 provides the same information and reflects the 

same statistical result reported in Table 1§* The upper set where 
i 

notetaking is the grouping variable provide a clearer depiction of 
the effects of training ^than the, alternative, . Note that at the 
means on notetaking for both groups, the differences of slope for 
the two " group s^a re inconsequential (see Table 19), However , high • 
notetakers with high ICR aptitude (at +1, standard deviation) .in the 

is f 

trained group had Mgh scores on Tagged Objective items , while their 
* trained colleagues who had high notetaking scores but low ICR 
aptitude had low ach ievement scores - The opposite result ©c*cure<l in 
the comparison group* Here, high aptitude, high not°^akerB- had v poor 
achievement while high aptitude, low notetakers were more successful 
ach ievers . 

These results can be interpreted as follows. The ICR aptitude 
test was designed to indicate the degree to which * students -were' able 
to interpret their teacher's intentions for* students 1 cognitive 
processing. The test was administered in early spring, after the 
students had -been working with their teachers for about seven 
months. Assuming that the teachers had not drastically altered * 
their teaching methods nor their intentions ,for student cognition 
after we had begun working with them* the ICR aptitude measure 
assessed an historical 1y* devel oped set of communications between 
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1 F^atatisttcs are reported for the regression equation containing all predictors 
remaining tn the equation (p < .101; fc-a tat i S 1 1 cs " arc* reported for each 
predictor's slope coefficient* , . 



The figure reported for the Total equation' is R" adjusted for shrinkage, , 
Those associated with each predictor are squared part (o'r semi part 1 *! 5 
correlations, ! , , 
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For aptt tudg-apti tude-treatment interactions or aptitude=notetakinfr* 
Eriititn^ 1 nteraettonSj the regression equations at ths mean of, the 
variable {for which group scores wife suhstltuded are equivalent to the 
aptltude-ftfektBJent interaction of the fiotetaktng^treatment interaction 
from the { precedi ng table in which the grouping variable does not appear t 
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teachers and students. Presumably, the students who scored high in 
ICR aptitude were those who had understood these communi cat ions more 
successfully than those students who had low scores* But 
understanding these intentions is nor the same as hei ng abl e t*o 
execute the instructional response that teachers intend* The 
training may have provided this capability, put only if the training 
were used* Thus, students who were suceessfu 1 at perceiving these 
intentions, but were unable or unwilling to execute the response had 
relatively poor achievement* This was the high aptitude, low 
notetaking trained group* On the other hand, some of the high 
aptitude, high notetaking students who had been trained now were 
capable of using and willing to employ a rather sophisticated 
cognitive strategy to learn from teaching* Their high notetaking 
scores constituLe prime facie_ evidence tint they used these 
strategies specifically in association with the teacher's signals to 
use them with content that was to be tested, 

Tn the comparison group, high ability, high notetakers 
performed poorly on the achievement test* Recall that their 
notetaking did not necessarily Represent the execution of an 
appropriate cognitive response. Rather, it simply indicate^} that 
these comparison group students had processed instruction and 
written something corresponding to tested content in their 
notebooks, but not necessarily at the point of the Wsson when this 
information was tagged by the teacher* High scores i ndi cated- more 
test appropriate notetaking, hut not necessarily the more frequent 
execution of an appropriate strategic cognitive response. Thus, 
these students 1 notes may be reflecting a high degree of sensitivity 
to any of' a host of varied instructional stimuli that they perceived 
somewhere in the lessons*, but the inappropriate or incomplete 
execution of a strategy for cognitively elaborating the information 
for storage in long term memory due to al locating too much cognitive 
resource to notetaking* As a result, % they were less successful on 
the test* This may have happened despite the fact that their high 
ICR aptitude scores indicated that they could recognize situations 
in which appropriate cognitive responses were being signalled. On 
the other hand, high aptitude, low notetaking students in the 
comparison groups were perceiving the teacher 1 s intenti ons for 
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cognitive processing* but were not distracted by the task of taking 
notes that were not necessarily representative of appropriate 
cognitive operations* as was ^notetaking in the trained group* These 
students, then* may have been attending to the important information 
to be tested later, and elaborating this information* for storage in 
long term memory by using idiosvncratically developed cognitive 
re s pon s e s ab ou t wh i ch we h a ve no data* 

The form of the ICR, Aptitude x Total Notes score x treatment 
group interaction on the Total Objective achievement score is quite 
different than the one discussed previously* The difference in 
intercepts between the two groups is slight numerically* as well as 
practically given the small effect size (E = .07^ at the ioint mean 
of ICR aptitude and Total Notes, However* note the regression 
coefficients for each group that show the relationship of ICR 
Aptitude to predicted achievement scores at three points (— 1 sd, M* 
+lsd)along the Total Notes, scale (X 2 for the' analyses reported for 
the. Total Objective scale in Table 20)* What is strikingly apparent 
is that the regression slopes for the two groups are negligibly 
different both at the mean and one standard deviation above the mean 
(-.15 and —*16* respectively^ for total notes taken/ But at — 1 
standard deviation the difference was -*41* Herein Ires the locus 
of the three-way interaction* High ICR aptitude students have 
higher total scores on the multiple choice test in this class if 
they take more notes, regardless of treatment group. For students 
who took an average number of notes* their achievement was . , . 
correlated to aptitude- Again, this was true regardless of 
treatment group. But treatment did make a difference for high 
aptitude students who took relatively few notes. For these 
students, achievement was relatively low whether they' were trained 
or not* However* the high aptitude low notetaking trained students 
performed better than their untrained counterparts* indictating that 
training did influence the cognitive responses of these students^* 

Turning to the essay dependent variables , ^the interaction of 
ICR Aptitude and Group was nearly identical on the Total Essay Scale 
and the Tagged Essay Scale* :in * the trained groups, students* 
predicted achievement was negatively related to ICR Aptitude* The 
opposite was true of students in the comparison group* 
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On the Non^Tagged Essay Scale, two interactions were 
observed* Prior Objective Achievement was proportionally related to 



in the comparison group* In contrast, students in the trained group 
who took more rather than fewer notes corresponding to non^-tagged 
information tested on the essay test were predicted to score lower 
on this essay scale* The reverse was the case in the comparison 
group where the amount of notes taken in non^tagged concepts was 
positively associated with predicted achievement* 



21* In this class, achievement on the essay test and its two 
subscales was not* affected differentially by the experiment since no 
predictors involving the contrast between groups accounted for 
statistically reliable variance in these three dependent variables 
(p > .10)* There we^e, however, statistically reliable and 
educationally important relations among students 1 scores oh the 
objective tests involving training and both prior achievement and ^ 
notetaking variables (see Table 22), On all three objective 
achievement scales , trained students generally outscored comparison 
group students* Effect size statistics based on the regression 
equations show that an average trained student scored at the 92nd 
percentile on the total objective test and at the 93rd percentile on 
the non^ tagged objective items compared to an average untrained 
counterpart* Although the same direction of effect was found on the 
tagged obiective scale, the magnitude of this effect was 
considerably less,. An average trained student scored only at the 
36th percentile relative to an average comparison group student. 

Table 23 displays the simplified regression equations for 
statistically reliable interaction terras that were retained in these 
backward selection regression analyses. For the two dependent 
variables showing large effect sizes (Total Objective Scale and Non- 
tagged Objective Items), opposite relationships between aptitudes 
and achievement resul ted for the two groups of students , When the 
^dependent variable was Total Objective Achievement, Prior Objective 
Achievement was inversely related to achievement in the trained 



predicted essay scores in the trained group, and inversely related 



Class B 



Descriptive statistics for al U. variables are displ^ved in Table 
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TABU 22 

Backward Belecfien Multiple Regression Analyses for Claaa 

Study IV 
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TABLE 23 

Simplified Regression Equations for Interpreting Interactions from 

Analyses in Class B, Study IV 



Dependent Variable Predictor (X) ' Wi thin-group Regression 

Equations * 



Total Objective 
Scale » 

Tagged Objective 
I terns 



Non-tagged 
Objective Items 
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1 x 


K ' 




6,40 
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Group 




c 




4,59 




,23X 







Note: For aptitude-aptitude-treatment interactions of aptitude-note taking- 
treatment interactions, the regression equations at the mean of the 
variable for which group scores were substituted are equivalent to 
the aptitude-treatment interaction or the notetaking-treatment ^ 
" interaction from the preceding table in which the grouping variable, 
does not appear, 



203 2ll 



groups but positively related to ach i evement in the untrained 
group* Thus, on the objective items as a whole* training allowed 
low aptitude students to achieve more 1 ike h i gh aptitude students 
who presumably used natural cognitive strategies during 
instruction. These two regression equations have their point of 
intersection at *1*2S standard deviation units or the 90th 
percentile on the Prior Objective Achievement Scale, We conclude on 
this basis that training does not hurt high aptitude students 1 
per formance , 

Students' performance on the non^tagged information tested by 
objective items was positively related to their prior essay 
achievement in the* trained group, hut unrelated in the comparison 

group* In other words f students who demonstrated more aptitude for 

/ 

learning information relevant to essay items by displaying that 
knowledge on a prior essay test profited more from training than did 
students lower in this aptitude* However, the point at which the 

i 

regression equations for the two groups intersect is at -*63 
standard deviation units or the 24th percentile on* the Prior Essay 
Achievement Scale* This suggests that it would not be very common m 
for a low aptitude student who was trained to make intended 
cognitive responses to achieve less than an untrained student* 
Thus f training boosted students* ability to learn information tested 
by non^tagged objective items overall, and especially for students 1 
with higher aptitude for learning essay-related information, 

The regression equations describing the interaction of the nnn- 
tagged notes bcqxm with treatment revealed that students who were 
trained to jnake intended cognitive responses did not profit further 
on non- tagged information tested by objective items by taking more 
notes while untrained students did. However* taking into account 
the differences in intercepts for these equations shows that 
untrained students must exceed., at least the 82 percentile in 
notetaking (+.90 standard deviation units) to match or better the 
achievement levels reached by trained students* Tt appears, then* 
that the majority of untrained students would profit from training 
because they could take fewer notes during class (about one-third as 
much) and still demonstrate relatively higher achievement, 

204* ""^ 



Several relations need' to be considered jointly in the 
interpretation of the interaction terms that emerged in the analysis 
of Tagged Objective Items, First, the interaction of students 1 
prior objective achievement and treatment took much the same form as 
this same interaction that emerged in analysis of the T otal 
Objective Scale, except that the point of* intersection was at the 
53rd percentile ( + *08 standard deviation units on the Prior 
Objective Achievement Scale)* Thus, this interaction describing 
learning of information that was tagged is much more disordinal than 
the former. The present intersection suggests that training 
students to make intended cognitive responses when cued by the 
teacher's instructional stimulus interferes with high 'aptitude 
students 1 learning tagged information* but promoted low aptitude 
students 1 achievement on this scale. Indeed, training made low 
aptitude students perform as well as high aptitude untrained 
students. 

The simple regression equations produced from the complex 
interaction of ICR Aptitude* notes made about information tagged by 
the teacher's instructional stimulus, and the treatment condition 
show several things (see Table 23)* First, the y=intercepts for the 
equations in which ICR Aptitude is the predictor (the first of the 
two blocks of six equations associated with ICR Aptitude (X^) x 
Tagged Notes (^2^ x Group in Table 23) progressiv^Ty increases as 
students 1 scores increase from =lsd to +lsd on the variable 
measuring notes taken about information their teacher taggfed with an 
instructional stimulus, Since the ICR Aptitude scores were deviated 
about the grand mean in these analyses, this progression of values' 
for the y^intereepts indicates that as average aptitude students 
took more notes about tagged concepts, their predicted achievement 
increases also* However* the interaction of ICR Aptitude and Tagged 
Notes indicates' that this relationship varies with the level of 
students 1 ICR Aptitude* 

In the experimental group, the relation between ICR Aptitude 
and predicted achievement on information tagged by instructional 
stimuli becomes less positive as students took more notes about 
tagged information. In fact* for students whose notes scores for . 
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tagged information were +1 standard deviation from the mean, there 
was a negative relationship between ICF aptitude and achievement on 
Tagged Objective Items. This suggests that students at low and 
average levels of aptitude for recognizing when to make appropriate 
cognitive responses profited from training when they took more notes 
about tagged information, but that students high in this aptitude 
would be predicted to score higher as thev take fewer notes* 
However, when trained students took r eJr=a-b i v e 1 y nfO're notes C+lsd) f 
only those students with ICR Aptitude scores that Exceeded the 69th 
percentile for their group had predicted achievement % ^&©je*s^£hat 
fell below those for trained students who took an average amount of 
notes about tagged information, This crossover point is at the 81st 
percentile of ICR Aptitude scores when comparing frequent notetakers 
(+lsd) with less frequent ones (=lsd)„ 

Thus * training students to make intended cognitive responses 
during lessons is somewhat beneficial in general* elevating their 
learningof tagged information tested by objective items to the 56th 
percentile relative tp average comparison students** These results 
could be interpreted as follows. Suppose that high ICR Aptitude 
students do not provide behavioral indications of the intended 
cognitive response we trained them to use because they don \ t use 
this mediation when the teacher tags information* Rather, they 
substitute a cognitive response that cffey presumably have developed 
by virtue of the fact that they exhibited high ICR Aptitude * 
scores. Following these assumptions, it is possible that these 
students have rejected our version of 'cognitive processing in favor 
of processes they prefer and have developed on their own (see Winne 
6 Marx* 1979)* In contrast , lower and middle ICR Aptitude students 
who used our intended cognitive response when cued by their teacher 
(the^ *lsd equation of the first block of six equations) are 
predicted to score very well indeed on this information as indicated 
by the highest y-intereept (4*96) and a negative regression 
coefficient (=*64) for this equation. 

Although training students to make intended cognitive responses 
was beneficial overall in this class, the complex interac tion of ICR 
Aptitude, Tagged Notes* and Group reveals that the effects of 



training are not alwavs superior Co no training, In fact, training 
is predicted to enhance achievement of information that the teacher 
tagged with an instructional stimulus only under certain conditions 
in this class. For students who took relatively fewer notes, no 
training was better if ICR Aptitude scores were below the 58th 
percentile* For those who took an average number of notes or a 
relatively larger quantity of notes about tagged inf orxuation, no 
training was better for students who scored below the 49th 
percentile or the 48th percentile, respectively* 
Class C 

On objective measures of achievement for- students in Class C, 
training in the use of intended cognitive responses was reliably 
related to learning* After scores had been residualiEed for prior 
achievement, students in the trained group ouEseored their untrained 
peers on the Total Objective Scale and on the Non-tagged Objective 
Items , reaching predicted averages of the 60th percentile on the 
former and the 76th percentile on the latter in comparison to 
predictions for an average student in the comparison group (see 
Table 24 for descriptive statistics and Table 25 for sunmiaries of 
regression analyses^. Thus, the training vielded a practical, as 
well- as a statistically reliable effect* However, there were no 
statistically reliable differences identified between trained and 
untrained students on objective items that tested information that 
the teacher had tagged with instructional stimuli* 

On the essay measures of learning, ICR Aptitude was a 
consistent variable that influenced relations among achievement, 
treatment, and in two of the three eases, notetaking by students. 
As well, the simple comparison of the two groups 1 predicted mean 
scores revealed that training deleteriously influenced essay^related 
learning overall and learning concepts that had been tagged by the 
teacher* In these two instances, average predicted scores for 
trained students fell to the 16th percentile on the Total Essay 
Scale and the 6th percentile on the Tagged Essay Scale, compared to 
the predicted average comparison student. The opposite effect 
occured on the Non-Tagged Essay Scale, however. On this scale, 
training aided leai m" ng, boosting predicted average achievement to 
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TABLE 25 



Backward Selection Multiple Regression Analyses for C*as§ f/ t 

Study TV 
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* F-itatlstlci are reported for the regression equation containing all predictors 
remaining in the equation fp < ,lQ°h t-etatlsttcB are reported for each 
predictor 1 ! slope coefficient, 

2 The figure reported for the Total equation is R" adjusted for shrinkage* Thoie 
associated with each predictor are squared part (or semi partial correlations. 
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che fiOth percentile relative to an average untrained counterpart, 
v i _ a . ... 

^rhese simple findings are modified by interactions involving 

the essay test scores. Consider the Non- tagged Essay S*. ale first* 
On this dependent variable, trained students with average ICR 
Aptitude scores slightly outscored comparison students also having 
average ICR aptitude, as indicated by the difference in y-intercepts 
in Table 26, (Recall that TCR Aptitude has been deviated about its 
grand mean, thereby making the v^intercept correspond to average ICR 
Aptitude * scores , ) Bu^ the interaction of aptitude and treatment 
indicates that this description does not hold across the range of 
scores for ICR Aptitude, In fact, beyond the 79th percentile of ICR 
Aptitude scores , ^ comparison group students are predicted to outscore 
their trained peers. Moreover, the negative regression coefficient 
relating ICR Aptitude and essay achievement of non-tagged concepts 
for the trained students (see Table 26) indicates the training put 
higher ICR Aptitude students at a disadvantage relative to low 
aptitude students with regard to achievement measured by the Non- 
tagged Essay Scale* 

Analyses of the Tagged Essay Scale and the Total Essay Scale 
both revealed similar complex interactions involving ICR Aptitude, 
the relevant note taking variable, ? and treatment. Consider the 
Tagged Essay Scale first* The y^ffntercepts for the simplified 
regression equations 'involving ICR Aptitude as the predictor (the 

-'third block of six equations in Table 26) show that predicted scores 
for comparison group students having average ICR Aptitude are at 
least as high or higher than those for trained students of average 
ICR Aptitude, Indeed t within any expected rangtf of ICR Aptitude 
(*3sd) untrained students who take a mean number of notes about 
information tagged by instructional stimuli are always predicted on 
average to outSGore trained students* Among students who took , 
relatively fewer notes on these tagged ._ concepts (-lad), an average 
student trained to make intended cognitive responses whose ICR 

1 Aptitude scores exceeds the 65th percentile is predicted to score 

better than an average student in the comparison group* However, 

■ j 
among students who took relatively more notes on the tagged concepts 

tested by essay items, an average trained student's ICR Aptitude 

needs to fall below the 3Qth percentile before the Tagged Essay 
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TABLE 26 



Simplified Regression Equations for Interpreting Interactions from 

Analyses in Class C, Study IV 



Dependent Variable 



Predictor (X) 



Within-group Regression 
Equations 



Total Essay Scale 



ICR Aptitude (Xj) x 
Total Notes (X 2 ) x 
Group 



E 1 
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1 . 92X t at +lsdX 2 
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C f 

C 
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3.20 ■> ,02X 2 at -lsdX 1 

3.41 + ,05X 2 at MXi 

2,08 - . 20X 2 at +lsdXi 

3.62 - .24X 1 at -lsdX! 
5.38 - 
3.60 + 
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.1 3Xj at +lsdX 2 



Tagged Essay Scale 



ICR Aptitude (X,) x 
Tagged Notes CXg) x 
Group 



E 1 
E' 
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C 
C f 

E f 
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E' 

C 
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C f 



2,13 + .52X! at -lsdX2 

1,51 - a6X 1 at MX 2 

.89 ~ •85X: at +lsdX 2 

3,68 - 1.14X, at =lsdX 2 

2.90 - . 27X. at HX 2 " 
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= 1.66 * ,05X, 



66 
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65 
65 
65 



= .oix; 

- ,osx; 

- ,06X. 
+ ,03X. 



at -lsdX 2 
at MX j 
at 4-lsdX^ 
at -lsdX l 
at m\ 
at +lsdXi 



Non-tagged Essay 
Scale 



ICR Aptitude x Group 



E 1 
C f 



1,84 - 
1,23 + 



, 72X 
72X 



Note: For apti tude-apti tude- treatment interactions or aptitude-note taking- 
treatment interactions, the regression equations at the mean of the 
variable for which group scores were substituted are equivalent to 
the aptitude- treatment interaction or the notetaking-treatment 
interaction from the preceding table in which the grouping variable 
does not appear, 
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Scale score* is predicted to exceed an average untrained students 1 

achievement. Thus, students high in ICR Aptitude who 

operational iEed training we gave them about making intended 

cogni tive responses , insofar as performing Che behavioral indicator 

was representative of these questions, were hurt. In contrast, 

students with higher ICR Aptitude who did less notetaking than we 

instructed were predicted to outscore untrained students. 

Although the crossover points vary *when Total Objective Essay 
scores are examined, the same relationships hold as were described 
for the Tagged Essay scores. Higher ICR Aptitude students who 
©perationaliEed intended cognitive responses at either average or 
above average (*lsd) levels achieved lower scores relative to both 
untrained students in general, and to higher ICR Aptitude trained 
students who recorded relatively fewer notes C^lsd), 
Operatienalizing training to make intended cognitive responses 
benefited only fairly low ICR Aptitude students in this class on the 
essay test. 
C lass D 

In this class (see Table 27 for descriptive statistics^, 
effects due to the treatment condition were observed for two of the 
three objective scales, and one of the essay scales (see Table 28). 
On the Total Objective Scale, the interaction of Prior Objective 
Achievement with Group, and the intersection of Total Notes with 
Group complicate the simple interpretation than an average student 
in the trained group would be predicted to score at the 95th 
percentile relative to the averge of the comparison group 
distribution* 

The interaction of prior achievement and treatment with the 
Total Objective Scale as the dependent variable is explored in Table 
29. The within^group ragrpiion equations show that training 
lessened the dependence of the Total Objective Test 

scoi as on prior achievement (b^,47), compared to untrained students 
who- used their natural cognitive processing strategies (b^l,48). 
However, predicted scores on the Total Objective* Scale -for trained 
students whose prior level of achievement exceeds the 82nd 
percentile begin to fall below those predicted for comparison group 
students. Thus, training students to make the cognitive responses 
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Mians, SUnhti Devlatieni, and Correlation AsQng All Variable! in Cliii E, Study IV 
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Backward Selection Mulct pit Regression Analvses for Class D, 

Study TV 



1 . * 2 



Dependent Variable Predictors g F/t * p variance 



Total Objective Scale 


Total equation 
Prior Objective 




1 0, 


1 7 




. 01 


.75 


1 .87 




Achievement 


68 


4, 


07 


< 


,01 


. 23 






ICR Aptitude _ , 


SO 


3, 


07 




,01 


,11 






Total Notes 


59 




08 




_ 01 


m i 3 




* 


Group 

Prior Obleetive 
Achievement x 


24 


1 . 


87 




,o§ 


,05 






Group • 


33 




16 




,05 


,06 






Total Notes % 


















Group • 


60 


3. 


21 




,01 


.14 






Constant (\1 


72) 


25, 


41 




. 01 


m 




Tagged Objective Items 


Total equation 




* 22, 


1 8 


< 


.01 


. 54 


"" 


ICR Aptitude 


7 ^ 




7 1 




. 01 


. 57 






Constant f6 




17. 


96 




! oi 






Hoit-tagged Objective 


Total equation 




1 2 


83 




* 01 


■ 77 


1 , 02 




Prior Objective 












, 39 






AcHi'e vemen t 


ftft 


5, 


48 




, 01 






= ICR Aptl tude 


45 


3, 


02 




■ 01 


. 1 ? 






Non-tagged Notes 


Si - 


- -3. 


77 




. 01 


,1 3 






prior Objective 


















Achievement s 


















Group 


41 


-3 


02 




.01 


.12 






Non-tagged Notes 


















x Croup 


61 


4. 


17 




,01 


. 23 






Constant ffi 


SO) 


27 


1 * 


< 


.01 






Total Essay Scale 


Total equation 
Prior Objective 




6 


33 




,02 


.23 






Achievement 


52 


2. 


52 




.02 


. 27 






Constant ^3 


n§) 


8 


78 


< 


,01 






Tagged Essay Scale 


Total equation 




5. 


57 




,03 


,20 




Prior Essay 


















Achievement 


50 


2, 


36 




,03 


. 25 






Constant 
Total equation 


U) 


9 


1 1 


< 


, 01 






Hon- tagged Essay Scale 




7 


82 


< 


, 01 


,43 




ICR Aptitude 


S3 


*i 


81 




. 01 


. 26 






ICR Aptitude % ^ 
Group 1 


33 


1 . 


81 




,09 


.10 






Constant t 


47) 


3 


01 




, 01 







* F-statisttes are reported For the regression equation containing all predictors 
remaining in the'equation (p < ,IQ)| t-statlsties sre reported for each 
predictors slope coefficient, 

2 The figure reported for the Total equation is R- adjusted for shrinkage. Those 
associated vtth.each predictor are aquared part for sent partial ) correlations. 



TABLE 29 



Simplified Regression Equations for Interpreting Interactions from 

Analyses in Glass D, Study IV 



Dependent Variable Predictor fX) Within- group degression 

Equations 



Total Objective Prior Objective E f ■ 14. 33 + ,47X 

Scale . • Achievement - x- Group. — • C* - 12.1 8 -h 1.48X 

Total Notes x Group 



Non-tagged Prior Oblect^ve 

Objective Items Achievement x Group 



Non^tagged Notes x 
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Non-tagged Essay ICR Aptitude x Group 
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.05X 
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was not beneficial tor all; only students In the first four-fifths 
of the distribution^ of prior achievement are predicted to benefit 
from training* 

In the case of the interaction between training and students 1 
total note taking during lessons, the wi th i n- group regress i on 
equations in Table 29 show that , for trained students , notetaking 
was essentially unrelated to their predicted achievement on the 
Total Objective Scale, In contrast, the more notes that comparison 
group students took, the lower their predicted achievement, Only 
comparison group students whose Total Notes score was below the 16th 
percentile would be predicted to outperform trained students, < Thus, 
for all but a very few students, training in making intended 
cognitive responses during instruction was advantageous* regardless 
of the extent to which those students operationalized their 
cognitive processing in the form of .notes taken during lessons 

The results for the Non— tagged Objective Scale parallel those 
for the Total Objective Scale* First, trained students outseored 
untrained students in general, averaging predicted scores at the 
85th percentile of the untrained students 1 distribution. And, as 
before, the same types of interaction effects complicate this simple 
comparison, In the case of the interaction of nH or achievement and 
treatment, training decreased the extent to wn ? -h * rior achievement 
predicted students* learning (see Table 29), uuwever , the crossover 
point for these two within— group regression equations was much 
nearer the raiddle^of the distribution of Prior Objective 
Achievement, namely, at the 53rd percentile, Thus, students below- 
average p on prior achievement profited from training, but with 
respect to information tested on the objective scale that was not 
tagged by the teacher, it was more beneficial not to train students 
to make cognitive responses to teaching if thejr prior achievement 
was above average. 

The interaction of students' notes about informa tion 'not tagged 
by the teacher c s instructional stimulus and treatment also was 
Statistically reliable when the Non-tagged Obieetive items served as 
the dependent variable (see Table 29), Tt showed that trained 
students would be predicted to outscore untrained students provided 
that they operational ized their, cognition in the form of notes at 
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least above the 26th percentile. Below that level of notetaking 
about non— tagged inf or^aEien* trained students' predicted scores 
fell below their untrained peers* 

Turning to the interaction of ICR Aptitude and Group identified 
in the analysis of the Non^tAgged Essay Scale, the within—group 
regression equations (Table 2 Q ) show that ahove^average ICR Aptitude 
students profited fr^m training, but trained students were predicted 
to score lower than comparison group students on this achievement 
s cal e i _f_.Jt h e ir .. ICR Ap titud e_was— b 6-1 ow aver a ge . -. 



In this class, there were statistically and practically 
significant effects of training students to respond cognitively to 
instruction on all three of the obiective measures of achieveraent . 
Descriptive statistics are displayed in Table 30, However, there 
were no statistically reliable effects of the treatment conditions 
on any of the essay measures of achievement* In the simplest terms , 
training was detrimental to learning, decreasing trained students * : 
scores relative to comparison group students to the 14th percentile 
on the Total Objective Scale and the Non^tagged Objective items, and 
the 30th percentile on the Tagged Objective Items. However, in each 
case, these simple differences are complicated by aptitude-treatment 
interactions, notetaking-treatment interactions, or both- Table 31 
reports the results of the backward selection regression analyses* 

When the Total Objective Scale was the measure of achievement, 
the treatment manipulation interacted with students 1 prior objective 
achievement and with the extent to which they took notes about test*= 
related information* In the case of prior obiective achievement, 
the within-group regression equations ( mmm Table 32) intersect at 
the 19th percentile on the scale for this aptitude. Thus, with the 
exception of all but a very few trained students win low prior 
objective achievement , predicted achievement was higher for students 
in the control group than for students trained to make cognitive 
responses during teaching, 

The opposite form interaction was found when students* notes 
was the interacting variable. However, because students 1 in the 
comparison group scored higher in general, only when trained 
students* Total Notes score exceeded the 92nd percentile was it 
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TABLE 30 



Mrini, iiindird Deviationi, and Correlations Anong All Variables k Cliii h Sty** J? 
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TABLE 31 



Backward Selection Mul si pi e Regregsion Analyses for Class E, 

Study IV 
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F=sfcatlstics are ^re ported for the* regress! on equation containing all predictors 
remaining in the equation fp <,!01; t-atatistles are reported Far each 
predietor ! s slope coefficient, 

2 - _2 

The figure reported for the Total equation is 1 adjusted for shrinkage* These 

associated with each predictor are squared part Cor seal partial 1 correlations. 
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TABLE 32 



Simplified Regression Equations for Interpreting Interactions from 

An.:- 1 yses In Glass E, Study TV 



Dependent Variable Predictor (X) Wtthln-group Regression 
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predicted that training facilitated learning relative to the control 
experience. Thus, for most of the students in this class, training 
served to depress scores on the Total Objective Scale, 

On the Tagged Objective Items, the wi thin-group regression^ 
equations show that, for students in the comparison group, ICR ^ 
Aptitude scores were inversely related to achievement on information 
tagged by instructional stimuli. But, for students who were trained 
to make cognitive responses s ICR Aptitude was proportionally related 
to achievement. Because the regression equations intersect at the 
75th percentile for scores on the Tagged Notes Scale, only when 
trained students greatly manifested their cognitive processing of 
tagged information by use of the behavioral indicator, did their 
predicted achievement exceed the comparison group students* 
achievement * 

The simplified regression equations involving either Prior 
Objective Achievement or Non-tagged Notes when Non-tagged Objective 
Items measured learning are nearly identical to those for the total 
Objective Scale (see Table 32), On this dependent variable, when 
trained students 1 prior achievement fell below the 26th percentile 
was their score predicted to exceed their average untrained 
counterpart's score. Also, only when trained students ' non^tagged 
notetaking scores, exceeded the 94th percentile was their achievement 
predicted to be higher than untrained counterparts. 

CONCLUSIONS 

As in Studies II and III and in earlier work (Winne, 19S2bf 
Winne & Marx, 1979), we showed here thrt students could be taught to 
execute cognitive responses intended by the teacher* Further, the 
results of the work in the five classes studied here show that these 
cognitive responses could be employed, at least in large part, while 
the students were working on standard recitation teaching tasks in 
regular classrooms. This is encouraging, particularly because t^is 
cognitive strategy was so complex. However, the contrasts between 
the total notes scores and the behavioral indicator scores suggests 
that the trained students employed the cognitive response somewhat 
inconsistently throughout the .lessons , at other times taking notes 
in a manner indicating Chat the intended cognitive response was not 
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used* Indeed, in Table 16, the average behavioral indicator scores 

corresponding to Che objective test items ranged across the classes 

i 

from 52 to 89 percent of the average Total Notes scores. For the 
essay tests, these figures were 44 and 79 percent. Presumably, at 
those times when the students 1 notes did not correspond to the 
behavioral indicator, they were using cognitive responses that they 
had developed prior to the training* 

As in the previous studies , the relationship between the 
students' use of the cognitive response and achievement was 
inconsistent* While on some achievement scales and in some classes 
this relationship was strong (see Table 17^, in other classes and 
with different measures of achievement , it was weak* For the 
trained students, the relationship was moderately strong (median r = 
*48) between use of the cognitive response and achievement on the 
objective tests, but not the essay tests (median r m - *23)* The 
opposite was. true for the relationship between notetaking and 
achievement for the comparison students (see p* 185 and Table 17). 
However, the interpretation of the simple relationships between 
notetaking and achievement must be tempered by the presence of 
several notetaking x treatment interactions that emerged in classes 
B, D and E with the objective tests serving as the dependent 
variables. These are discussed below. 

A summary of the various regression analyses performed in data 
in the five classes is reported in Table 33. Of the three aptitude 
measures J " the two measures of prior achievement most often appeared 
as statistically reliable terms in the analyses* Interestingly 
while the measure of prior achievement on the essay test appeared 
more frequently in analyses in which the various essay measures 
constituted the dependent variable, both the objective and assay 
measures of prior achievement appear equally often when the 
objective measures served as dependent variables* ICR aptitude 
appeared as a predictor of achievement only in class D* 

Notetaking appeared as_ a reliable predictor of at least one 
achievement measure in clisses B f H, D, and E, The relationship was 
positive^ in classes B and p f but negative in classes D and E* These 
relationships, however* are moderated by the presence of several 
notetaking x treatment interactions* as referred to above. 
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The simple treatment contrast proved to be statistically 
reliable in four of the five classes for eight different regression 
analyses, seven of which involved one of the objective achievement 
scales* In class 12, the contrast favored the comparison group, All 
other s tat istical ly reliabl e treatment contrasts favored the trained 
groups . 

The most complex findings concern the aptitude x treatment and 
the aptitude x notetaking x treatment interactions* These are 
summarized in the seven columns on the right hand side of Table 33* 

While ICR aptitude entered the regression analyses as a simple 
terra only in class D, it appeared in either two*= or three-way 
interction terms in all classes. From these daca* it appears that 
the ICR aptitude measure has potential utility in uncovering 
relations in instructional research* However* like many aptitudes 
employed in the study of aptitude-treatment interactions, there 
appears to be a lack of reproducibility. For example , in the seven 
regression equations in which a two-way interaction appeared 
involving ICR aptitude, three indicated that high aptitude trained 
students and low aptitude comparison students scored higher* while 
four were of the opposite form* 

However, some regularity appears in these results when the 
analyses are clustered by type of dependent variable- For the 
objective measures, only analyses involving the Tagged Objective 
Items included notetaking x treatment interactions (for classes B 
and E, see Table 33)* Both of these analyses were of the same form, s 
where trained students with high aptitude outperformed their 
untrained peers ofl equivilent aptitude* while untrained students 
with low aptitude outperformed their trained peers. Of the five 
times that notetaking x treatment interactions appeared in 
regression equations that had an essay measure as the dependent 
variable'! four of the five had positive slopes for the comparison 
group and negative slopes for the treatment group. Generally, this 
showed that high aptitude comparison group students outscored high 
aptitude trained* students. The exception was class D* where the 
high aptitude trained students were superior. 
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The prior achievement measures appeared in eight interaction 
terms with the treatment contrast. In seven of these regression 
equations an objective scale served as the dependent variable, with 
six involving the prior objective achievement items. In all of the 
equations where an objective scale served as the dependent variable 
and prior objective achievement interacted with treatment, the 
comparison group had a positive slope. The slopes for the trained 
groups in these classes (H, D, and E) were both positive and 
negative. In all cases, however, comparison group students with 
high prior objective achievement outperformed their trained peers, 
while trained students with lower prior objective achievement had 
higher predicted objective achievement scores than did untrained 
students. Thus, training served to attenuate the relationship 
between prior knowledge and achievement. This was particularly 
helpful to low aptitude students, for whom training served to 
increase scores to the level of untrained high aptitude learners. 

On the one prior obiective achievement x treatment interaction 
with an essay test as the dependent variable (non-tagged items), the 
higf i aptitude ^ineT^ tudehis "and the" low aptitude comparison group 
students scored, highest . Thup", |there was no evidence that training 
was able to help students «5Sf€£^e ability limitations on the essay 
lest. Because, this interact inn occured in only one class and did 
mot replicate, gentfraJ^tfiontr&afeed on it is hazardous, This is 
| 80 true of. the ^Shl^eraSon involving prior essay achievement 

>i»nd\tren tmen fcj , ^-"^ .] )> ; 
«!"•" ^ei,ther ' bfiiihe prior "aehiiviinent measures appeared in a three- 
"waAnt^ctlSn? These interactions all included the ICR aptitude 
tost as the measure of aptitude, ■However, because of the strong 
^likelihood that these effects are unstable, we judge it unwise to 
"^speculate more than we already have about these relations, 
" especially in the light of the absence of reproducible effects 
across the five-classes (see Table 33). Karlier discussions of 
'these relations were included for speculative and exploratory 
reasons only. But, in accord with the caveat proffered in chapter 
3, we choose not to lend farther weight to these effects by 
summarizing them, that thev were statistically reliable in the 
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individual analyses does not overcome our skepticism about their 
meaning. Though this same argument can be carried back to simpler 
effects, we have chosen not to employ it there because of the 
semblence of reproducibility that emerged for these findings* We 
point again to the caveat made earlier as sufficient warning about 
the statistical and the subsequent substantive robustness of the 
findings in toto* 
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CHAPTER 6 
Conclusions and Implications 



At the end of each of Che previous chapters, we have i provided 
summaries or conclusions relating to the data presented in those 
chapters* Here, we draw together those findings and discuss 
conclusions and ' implicat ions that arise from the project as a 
whole, 

CONCLUSIONS 

Research on teaching through the 1970s was based on a set of 
presuppositions about how teaching events were related to 
students' achievement* Along with methodological rules* these 
presuppositions constituted the process-product paradigm* One of 
these paradigmatic presuppositions underlying process-product 
research was that process variables, in the form of teacher 
behaviors such as statements of praise or higher-eogni tive 
questions, directed students 1 on-the-spot cognitive operations on 
the content to be learned, Another presupposition was that the 
immediate products of these cognitive operations could be measured 
later by administering an achievement test to students, Thus 
process-product research sought to identify and explain., relations 
between process variables operationally defined is teacher 
behaviors and students 1 achievement as represented by paper and 
pencil tests. It is important to note that, while researchers 
frequently used language that implied the existence of the 
intervening student cognitions relating these phenomena, rarely 
was the link between teacher behavior and student cognition 
explicitly discussed* 

To interpret relations between these two categories off data, 
however, several other tacit assumptions had to supplement those 
already made. These tacit assumptions included at least the 
following: ( 1 ) Every occurrence of a uniquely operationally 
defined teacher behavior is associated with only one set of 
students 1 cognitive operations, (2) Every occurrence of any 
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operationally defined teacher behavior invariably results in a 
cognitive product that, once students have created it, could be 
reproduced invariantly on an achievement test, (3) Every student 
in a single classroom of treatment , group experiences the same 
teacher behavior that the researcher operationally defined as the 
independent variable, This happens every time the teacher 
behavior occurs* These three tacit assumptions permit a 
researcher to perform logical and quantitative operations 
necessary to do thfngs such as compute a correlation coe fficient 
between a teacher's use of a teacher behavior and the class Cor 
group) mean on a measure of achievement and interpret it in terras 
of a theory of learning (Gage, 1964^ or motivation (see Winne , 
1983a, b, for details), 

A notable characteristic of each of these three tacit 
assumptions is that they make statements about some aspect of a 
student's covert cognitive operations in relation to observable 
events of instruction* As we argued in the first chapter, a 
series of empirical studies and logical analyses of the process^ 
product paradigm produced some doubt about the paradigm's 
appropriateness* In particular* over the last decade a growing 
number of studies questioned the validity of each of the three 
tacit assumptions just mentioned* The studies comprising this 
project demonstrate clearly that such doubts are warranted. In an 
attempt to accomodate these findings, we adopted a new 
paradigmatic stance, ^ 

Whereas the proeess^prbduc t paradigm relied on assumptions 
about students 1 cognitive responses to instructional stimuli as 
defined a priori by a nori^participant in instruction (i*e», the 
researcher), the cognitive mediational paradigm takes a more 
descriptive and mor e^r i gdrou s s t and oft th il"~i s sue . Its rigor 
derives from the fact that it requires operational documentation 
about both students' cognitive operations during the course of 
instruction and the cognitive products that these operations 
yield. In this proieet , documentation about these phenomena was 
secured by two procedures! stimulated recall interviews of 
students in Study I, and the methodology of behavioral indicators 
in Studies II - IV. ^ 
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As to the increased descriptive power of research guided by 
the cognitive mediations! paradigm, this was achieved by 
explicitly accomodating the fact that students 1 vary in their 
naturalistic use off tfo^gnitive operations as well as in their 
achievement off cognitive products during instruction,^ Such 
accomodation took three forms in Studies II - IV of the project, 
The first form was to train students to perceive and act on 
instructional stimuli. This sharpened process^product methodology 
by reducing the range of variation in students' cognitive 
mediation that was observed in Study I, By training students in 
this manner, we attempted to control the goals students approached 
during instruction and the cognitive products they attained. This 
control was operational ized by determining a priori ^the cognitive 
operations students would draw on and by providing criteria in the 
form of behavioral indicators for them to judge their success at 
these tasks. As well , by tying these cognitive events to 
instructional stimuli delivered at specific points in the 
development, of content in lessons, we attempted to control the 
amount of information students processed. Finally , by previously 
acquainting students with the exact structure and function of 
cognitive responses to chosen instructional * stimuli f we tried to 
govern the immediacv of their cognitive mediations of these 
instructional stimuli. 

The second form of accomodation we made to naturalistic 
variation in students' cognitive mediation of instruction 
concerned the assessment of cognitions at the time they occured 
during instruction. We did not assume that students necessarily 
would cognitively mediate instructional stimuli as had be a en 
presumed a priori in process-product research. Instead, we 
assessed the extent to which students actually used particular 
cognitive responses by collecting behavioral traces of their 
cognitive mediations. This measurement provided an index upon 
•which to base interpretations about how instruction influenced 
immediate cognitive responses, which in turn related to 
achievement. This description served to reduce further some 
sources off variance that were extraneous to the propositions 
tested in these studies, * " 
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motivation, In the training sessions, special emphasis was made 
of Che ways that the cognitive mediations being trained could 
support students when they responded to achievement test items. 
We assumed that demonstrating this congruence would motivate 
students to carry out. nearly equivalent cognitive mediations in 
^hicn they were trained, both during instruction and later when 
they responded to test items calling for those same cognitive 
mediations • 

In gauging the qualities of * these accomodations, students 1 
behavioral indicators served as descriptive data f or evsiuati ng 
the extent to which the research in Studies II - IV accomodated 
the observations made in Study I* From another perspective, the 
latter three studies of this project tested rather than assimied 
the four components of successful cognitive mediation of 
instructional stimuli that Winne (1982a) identified. This 
provides both logical and methodological advantages to cognitive 
mediational research on teaching relative to proeess^produc t 
research, 

In an effort to enhance or at least address teaching 
effectiveness in the project, we designed the cognitive mediations 
students were trained to use in Studies II s IV by building on 
prior findings from psychological research fe.g*, Gagne, 1978) and 
From previous interpretations of process-product research on 
teaching, The hypotheses we advanced obviously evidenced our 
"informed commitment M Cef* Punkin 6 Biddle, 1974, concerning less 
informed commitment) that students-who were trained to carry out 
cognitive operations we identified should have learned more. 
/Ithough this simple relation was only partially supported, and 
usually was complicated by interaction effects, there was some 
evidence that we were able to elevate trained students 1 
achievement relative to untrained peers* Riven the novelty of 
this approach to research, and the problems we encountered, these 
fimjinjis can be taken as indications about the potential of the 
cognitive mediational paradigm to foster research that is both 
theoretically and practically useful, Specifically, theoretical 
proposi'tions about how students' cognitive mediations of 



instruction influence learning can be examined by cognitive 
raediational research because these cognitive operations are 
defined and observed in the immediate environment of teaching 
rather than at a later time and indirectly by students' total 
scores on achievement tests (Snow, 1968)* Practical utility also 
may derive from more exacting descriptions regarding what students 
can do cognitive ly when 1 the v participate in instruction, thereby 
prescribing how time on task can be filled to promote achievement 
(ef* Gage* 1978), But research that achieves these gains will 
Lead to solve several problems encountered in or raised by the 
studies reported here* 

Problems in Cognitive Mediational Res_g_arch 

In many respects , a maior focus of this project has been 
methodological* A broad sense of the term methodology is intended 
by this statement f meaning "the description, the explanation and 
the iusti f i cation * * * of methods, and not merely the methods 
themselves" (Kaplan, 1964 fi p, 18)* But a series of difficulties 
or weaknesses also character^* ^ed the methodology of this 
project. In this section, we discuss concerns of this nature in 
order to place appropriate bounds on the validity of the current 
findings and to note issues that future research will have to 
K address* 

/Identifying cognitive mediations * Threats to the validity of 
co^wlfusions from Study I have been summarised and debated by 
Nisbett and Wilson (1977) and Ericsson and Simon (1980), Our 
methodology fails to meet the standards of validity mentioned in 
these works, but neither is it so messy as to warrant outright 
dismissal (e*g*, see Peterson, Swing, Braverman, & Buss, 1982 for 
one adoption of a nearly identical procedure)* It can be 
considered as one source of potentially useful and valid 
descriptions of students' cognitive mediations of instruction* 
albeit one subject to some difficulties. Several of these 
difficulties warrant explicit attention. 

Tobias (1982) and Halfee (1981) distinguish raicroprocesses 
and macroprocesses * The former are elementary cognitive 
operations, They may be under conscious control, such as 
rehearsal in the form of simple repetition, or they may not be 



233 2 4 0 



consciously regulated* such as di s criminating vertical from angled 
components of letter forms* Macroprocesses f on Che other hand* 
are assemblages of microproeesses that probably correspond to 
plans for dealing with instructional events. Reviewing 
information to organize it more compactly and to monitor the 
degree to which parts of this organization make sense is a likely 
candidate for an instructionally cued maeroprocess * 

Analysing students 1 stimulated recall protocols to identify 
cognitive mediations is problematic in several respects* First* 
students are naive with respect to reflecting metacognitively f 
making their descriptions -ambiguous in many, if not most 
instances* Second , when microproeesses and macroprocesses are 
highly automatic, students 1 are likely not to be aware of them and 
thus are unable to report their occurence* Third* to the extent 
that cognitive mediations involve macroprocesses that include 
orienting or cognitive responses that are to take place at a later 
time in the lesson, students may be unable to describe them. 

Two approaches to dealing with these and related issues 
(Ericsson & Simon, 1980*) can be proposed* One is to provide 
students with a brief education so that they can identify and 
describe cognitive events in terms commensurate with those used by 
researchers to describe cognition* This may help to lessen the 
gap in communication between students and researchers by lessening 
students 1 naivete* A second approach may be to devise 
instructional tasks that segment macroprocesses into either 
smaller macroprocesses or microproeesses that are of interest to 
the researcher * and requiring students to create behavioral traces 
that correspond to cognitive operations and cognitive products 
that can be examined (e.g. , see -Brown 5r Burton, 1978). 

Of course* a third source that can be drawn on to identify 
microprocesses and macroprocesses that may characterise students 1 
cognitive mediations of instruction is the vast literature of 
cognitive psychology* Tapping this source may need to be done 
with some caution, however, since this literature may exhibit some 
problems when identifying cognitive mediating operations. One 
caution, often given lip service but perhaps too rarely heeded in 
practice, is to consider possible developmental differences in 
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forms for raacroprocesses. At the least, variations in the 
capacity of working memory tnav need to be addressed. , 

A second caution pertains to the use of nomothetic research 
strategies to study cognition* In most of these studies, data 
have been aggregated oyer multiple occurrences of a treatment 
variable (e.g., underlining terms in a text) and over students, 
Idiosyncracies in the cognitive activities of individuals as they 
respond to the same variable over time are aggregated into the 
uninformative category of residual variations. While such studies 
may describe "average" cognitive operations validly, it may be the 
case that the idiosyncratic variations would be a better source 
for identifying ins true ti onally relevant cognitive mediations than 
models of the cognitive activities of a hypothetical ly average 
student, who, in fact, might not exist (see Winne, 1983a). 

Tracing cognitive mediations , Hie behavioral indicators we 
designed to reflect students' cognitive mediations or some valid 
substitute for them are an essential component of cognitive 
mediational research on teaching. Several problems with obtaining 
these traces of students' cognitions can be described. 

One difficulty with the behavioral indicator methodology 
regards fitting it into teaching ser-that it does not disrupt 
instruction, but supports it. There are several aspects to this 
problem. One of them is that, while students are engaged in 
producing a trace of cognitive mediations, they probably have to 
disengage eognitively from other potentially relevant 
instructional activities, e.g., listening to the teacher. In 
Studies XT and tit* it was relatively easy for us to create 
instruction that employed long teacher wait time, In Study IV, 
however, where instruction was more interactive than it was when 
it was delivered by videotape, as in Studies II and III, the 
teachers found it difficult to provide this wait time consistently 
following delivery of the instructional stimulus, This may have 
been an artifact of our design of Study TV.- Had all rather than 
just half of the teacher's students been trained to engage 
specific cognitive mediations and produce behavioral indicators, 
we may havebeen able to avoid the need for teachers to keep non- 
trained students engaged. Similarly, they would not have had to 
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respond Co the initiations of non-trained students during the wait 
time in which trained students were recordine behavioral 
indicators* When instruction and students participating in that 
instruction are matched to take account of Che wait time teachers 
must provide f oF-^ather ing data in the form of behavioral 
indicators, this artifact may disappear* 

A second aspect of lack of fit relates to students' 
propensity to produce behavioral indicators. At several points in 
our earlier discussions, we speculated that some students trained 
to use cognitive mediations may have done so but subsequently not 
provided a trace of those activities* Unless behavioral 
indicators per se have utility for students during the course of 
classroom learning, obtaining these data may be problematic* "Hie 
motivational link we made between the cognitive mediating 
strategies students were trained to use during instruction and 
then again upon encountering a test item that could be answered 
using the same strategy * apparently did not induce the 
participants to record behavioral indicators at nearly the 
frequency that we would like in order to make stronger inferences 
regarding cognitive mediation of teaching* This problem needs 
attention in future work, Perhaps merely making these traces an 
automatic response, by considerable practice, will help to insure 
their production 

A different problem with behavioral indicator data that waff 
partly addressed in Studies II and III, but inadequately addressed 
in Study IV, are the links across specific occurrences of 
instructional stimuli, behavioral indicators , and achievement test 
items. Ideally, each triplet ™ instructional stimulus* 
behavioral indicator, and one or a set of test items solely 
dependent on a cognitive product resulting from the execution of 
the intended cognitive response m — would be available for 
examination by the researcher, These kind of datas however* were 
not available in Study IV for two reasons, First, we could not 
invent a workable procedure by which students trained to provide 
behavioral indicators could log which occurrence of their 
teacher's instructional stimulus triggered their use of the 
cognitive mediational strategy. Thus, the link between the first 
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pair of items in the ideal triplet could not be assessed 
accurately for everv student. Second, the generalized intended 
cognitive response designed for Study IV was representative of 
each classroom's milieu. But achieving this degree of 
representativeness and allowing freedom to the teachers to deliver 
all other aspects of instruction in their own way prohibited 
making the second link in the ideal triplet* This trade-off 
between internal validity and representativeness (Snow, 1974) 
lessens that inf ormativeness of our data about the relations among 
items in the ideal triplet. Work* to improve on our procedures in 
the context of classroom teaching is needed* 

The last problem with behavioral indicator data is the most 
fundamental. If behavioral indicators of students 1 cognitive 
mediation of instructional stimuli are to be useful, they must 
have construct validity. That is, behavioral indicators must 
reflect the cognitive operations and cognitive products they are 
intended to reflect* In Studies Il/and III, the behavioral 
indicators we designed approximated the criteria listed on pp. 
164-166, But Study IV provides an illustration of an experimental 
setting where other, more substantial problems can arise with the 
behavioral indicator methodology, The first of these derives from 
the fact that the behavioral indicator in Study IV was reactive 
both to a student's state of prior knowledge and to sequential 
events in the classroom. In part, this reactivity reflected the 
representativeness of the cognitive mediation that was designed 
based on data from the first phase of Study IV* But the trade off. 
is that not all aspects of the behavioral indicator can be 
interpreted unambiguously, For example, if a student's behavioral 
indicator for Stage 1 is incomplete, it may be so because the 
instructional stimulus was not perceived, prior knowledge was 
lacking, or one or two parts of the cognitive mediations (see 
Figure 3) were not performed. 

A related/ problem arises when behavioral indicators reflect 
macroprocesseS| that are not invariant, such as having several 
branches in a procedure. IF, for example, a students' partially 
correct answer to a teacher's question resulted in the teacher 
going off on a tangent and never returning to the topic of the 
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question, students who were listening to this exchange would have 
needed to alter" the second and third stage of their intended 
cognitive mediations and, hence, behavioral indicators* However, 
we did not provide a means for them to note this or other 
deviations from our one path through instructional events. 
Misinterpretations of incomplete behavioral indicators would 
result were this hypothetical situation to have oecured in the 
study* Although better data collection procedures concerning all 
three items in the ideal triplet would help to counter this 
weakness* problems of this general type may be inherent in 
research of this genre unless the teacher follows a script very 
closely* Work in this veirt merits attention in the near future* 
Data anal y_svs * ^ %wo problems are associated with the models 
of statistical analysis that were used in this research* Notable 

among these is the fact tha r , if .students are discarded froin_.a 

randomly constituted treatment gdbup because their behavioral 
indicator data sustains the interpretation that they were not 
engaging in cognitive mediations as intended* the remaining group 
is non=rsndom. This violates any traditional statistical 
procedure that rests partially on the assumption of random 
assignment (and retention)* Both the internal validity of the 
study's design and the lack of bias in statistical- estimates of 
parameters are threatened by systematic mortality of participants 
in a study* 

A second difficulty, especially serious in Study IV, is the 
fact that every single classroom must be treated as a unique 
population because unmanipulated instruc tional, stiraul i and 
associated cognitive mediations vary across classes. This 
severely limits sample sizes with resulting losses to the 
robustness and precision of point estimate statistics such as 
means and partial regression coefficients, 

These two problems, particularly the B second, are associated 
with research on teaching derived from the process-product 
paradigm as well as research based on the cognitive mediational 
paradigm* As discussed earlier, teaching influences students in 
many ways. It is unlikely that all students in a classroom react 
cognitiyely in the same way to a particular teaching event* 



Obviously, if this were the case, these students would not be 
reacting similarly to Che range of teaching events that constitute 
a more global treatment. If the focus of one's theory of teaching 
is Che reactions of individual students, then aggregating data 
across students reduces precision with regard to those individual 
reactions 

These two problems underlie our strong position presented in 
Study II, about treating the statistical findings of Stud. ^ IT - 
IV as descriptive and tentative. Clearly, substantial effort will 
be needed to solve these problems. Although such work has begun 
(Winne, 1983a^ the range of issues concerning ways to analyze 
data from cognitive mediations! research is very large and quite 
unexplored. 

*. 

Recapitulation 

There is no lack of problems to be conquered in making 
cognitive madiational research on teaching more valid. ■ The ' 
standard trade-offs among internal validity and represen- 
tativeness, redundancy of data and intrusiveness of data 
collection, and the like, infect the research characteristic of 
this paradigm just as much as that characteristic of the process- 
product paradigm. Nonetheless, the advantage of being able to 
test cognitive explanations of" teaching effects that is offered by 
.a cognitive mediational perspective is substantial. On the 
strength'of this attraction, solving or lessening the problems 
posed by cognitive mediational research on teaching seems well 

worth the effort. 

As one of the first integrated series of studies reflecting 
this approach to research on teaching, these problems were 
difficult to forecast prior to experiencing them. Hence, the 
substantive weight of our conclusion.; is not as significant as we 
had hoped. Exploratory programs of research probably should not 
be expected 'to yield substantive breakthroughs. However, the 
project does have some important findings that can help structure 
future activities in the field. We turn to those implications in 
the next section. 
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IMPLICATIONS 

This project offers implications for several audiences, In 
this section, we discuss some of these implications for three 
significant groups — researchers* teachor educators, and 
teachers . 

Implications for Researchers 

In the preceding section, problems were identified that are 
associated with research on teaching carried out within the 
cognitive mediations 1 paradigm, Obviously, two implications for 
researchers arising from that section are that those problems need 
to be articulated more clearly, and that solutions to these 
better-framed problems should be sought. In Kuhn's (1970) sense, 
this work will constitute the puzzle-solving activities 
characteristic of normal scientific development within a 
paradigm. But the features of this project also have other 
implications for researchers that are more general than those 
related to solving the fairly specific set of problems identified 
"previously. 

The sort of research illustrated in this project represents 
two fundamental shifts in the philosophical foundations of 
research on teaching In process-product research, relationships 
between a specific teacher behavior under investigation, such as 
praise, and student achievement were taken as constant* By this 
we mean that an a priori; operationally defined instructional 
stimulus was deemed to have^only one effect on students 1 cognitive 
mediation of instruction which, in turn, either did or did not 
have a corresponding effect on how students responded to test 
items. Brophy's (1981) recent review of process-product research 
on teacher praise demonstrates the prevalence of this assumption 
and its untenability (see also Winne, 1982a s for a generalized 
argurae nt). 

Study I of this proiect. demonstrates that a single 
instructional stimulus can have multiple effects on students' 
.cognitive mediations. We hypothesize also that different 
instructional stimuli can have the same effect on students' 
cognitive mediation. • Moreover, depending on a particular 
student's assimilation of information presented over time, whether 
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hypothesize that relations between instructional stimuli and 
cognitive mediations can vary for that one individual. In short, 
relations between instructional stimuli and students 1 cognitive 
med iat i ons are var iabl e over time and context rather than 
constant* This change in assumptions regarding the relationship 
between teaching and learning will require recasting models of 
instruction that grew from earlier research traditions. 
Specifically, teaching events will need to be viewed as conditions 
which establish opportunities for students to pursue cognitive 
operations i.e., as intentional acts (see Scheffler, I960), rather 
than as causes of singular cognitive operations that students 
undertake. The philosophical, methodological, and practical 
ramifications of this shift need to be developed. 

A second basic shift in the philosophy of research on 
teaching that links to the first is that cognitive activities in 
which students engage are now the loci for determination of 
instructional effects. This shift places the agency or mechanism 
of change completely within a hypothetical construct* i.e., a ^ 
cognitive operation such as rehearsing, rather than allowing it to 
straddle the fence of observability in the form of a teacher 
behavior-pius=*cogni t i ve operation that causes achievement, As 
with the first shift in assumptions, the implications of this 
relocation of causes of observed instructional effects need to be 
spelled out as regards such basic issues as the internal validity 
of experiments and the interpretation of effect si^e statistics. 

Beyond these basic philosophical questions, this project also 
points to a series of extensions to the methodological suggestions 
made by Berliner (1976^, Dunkin and Biddle (1974), and Snow 
(1974). We adopt two of Berliner's four categories to describe 
these extensions. (The methodological and statistical categories 
were treated earlier, so they are excluded here.) 

Dependent variables * The content validity of an achievement 
test typically has been indicated by the proportion of its items 
for which information needed to answer an item was presented 
during lessons. The cognitive raediational view will add to this 
notion a nee<j to measure the correspondence between cognitive 
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operations students use to respond to instructional stimuli and 



.cognitive operations students engage to respond to test items* 
This type of consideration was exemplified in Studies IT and 
III. This additional measure^ anchored in behavioral indicator 
data, also will help to operationalize aspects of transfer that 



Mayer, 1979), 

AT sDj the degree to which an achievement test reflects the 
effects of instruction is augmented under the cognitive 
mediational paradigm* Some prior studies of research on teaching 
have been criticized because they used standardized tests to gauge 
effects in short=term studies* Researchers have responded by 
constructing curri eulum^spee i f ic tests. By adding cognitive 
mediating strategies to the curriculum, such as hypothesis 
formation (see Marx & Winne , 1981), concern for the sensitivity of 
achievement tests now expands from the single dimension concerning 
content covered to include a second dimension of cognitive 
mediational strategies (cf, Gagne & Beard, 1,978)* This is partly 
illustrated in our research by the measures of training effects 
employed in Studies IT - TV, 

Finally, the constant call for multivariate dependent 
variables can be responded to in part hy developing scoring 
schemes like those we used to score essay test items in Studies 
TI^IV* Extensions of these procedures to other dependent 
variables defined simultaneously by content, cognitive mediating 
strategy, and format of the test item (a retrieval task stimulus 
corresponding in kind to instructional stimuli that students 
experience during lessons) will need to be developed, 

■ Independent variables , In future research, but especially in 
non-intervention studies where teachers 1 delivery of instructional 
stimuli is uncontrolled by a research design, "independent 11 
variables should be considered from^two distinct perspectives* 
The traditional perspective corresponds to instruction as the 
researcher sees it ? the nominal instructional stimuli of previous 
process^produe t research studies* The second perspective applies 
the criterion of the cognitive function of instructional events to 
define instructional stimuli, Whereas the former is an a priori 



have heretofore been vaguely gauged in research on teaching Cef, 
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seance for defining hypotheses, the latter is an a posteriori 
procedure for defining effects, contrast between these 

positions, highlighted in Study X f will help to describe the 
construct validity of putative causes (Cook & Campbell, 1979) or 
conditions of instructional effectiveness, - 

A problem with the vast majority of prior experimental 
research has been its focus on only one or a very small set of 
instructional events that were defined a priori and only in terms 
of teacher activities (e.g., Gall, Ward, Berliner* Cohen, Winne, 
Elashof f , a Stanton, 1978i for contrasts, see Clark et al, f 1979 
and Good Sk Grouws, 1979), The possibility rarely was considered 
that other, undefined instructional stimuli surrounding the 
treatment variable(s) operationalized in a study also influenced 
students* cognitive mediations and achievement. For instance, in 
a review of experiments studying the effects of higher cognitive V 
questions on achievement, this incompleteness of operational 
definitions for treatment Factors led Winne (1979) to ask, "What 
was the treatment?" The inclusion of behavioral indicator data in 
studies where students respond to any instructional stimuli they 
perceive, an extension of the procedure operationaliged in our 
Study TV, will permit treatments to be characterized both 
functionally and more fully* This also will enlist participants 
in the instructional acts of lessons, i.e., all the students, to 
serve as observers of the fidelity of implementation of treatment 
cond itions . 

Summary * Addressing the problems uncovered and described by 
this project should assist in the pursuit of theories of 
teaching, These theories will be interrelated by their use of 
students 1 cognitions as the basis for explaining how teaching and 
learning interact to affect achievement. By recasting the role 
attributed to instructional stimuli in the instructional process 
and by improving methodology for observing students 1 cognitive 
mediations, future research also should be able to formulate 
research questions much more precisely than was possible before. 
Implications for Teacher Educators , 

The upsurge of cognitive psychological views of teaching and 
learning has the potential to exert a substantial influence on 
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both the curriculum of teacher education programs (see Marx & 
Winne, 1981) and on practices for suoervising pre-service 
teachers* Although it would not be prudent to over^extend the 
findings of our studies by immediately prnpoRing strong 
prescriptions for teacher education, there are several suggestions 
that can be offered. 

A major component of teacher education programs focuses on 
providing pre-serviee teachers with competence to use an array of 
discrete teacher skills and to orchestrate these into 
strategies* This project makes clear the need for pre-serviee 
teachers to learn how to examine the ways that these teaching 
skills and strategies actually influence students since these 
influences cannot always be predicted reliably. Behavioral 
indicators can help satisfy this need* As well, student teachers 
will need preparation in means for analysing the cognitive 
operational requirements of tasks that are posed for their pupils 
by teaching. Conceptually, this parallels the preparation they 
may receive in task analysis. i,e,, analysing the requirements of 
tasks by which students demonstrate achievement f Shave! son, 
1981). Learning to design behavioral indicators will require pre- 
service teachers to give thought to how pOpils are intended to 
cognitively mediate teaching skills and strategies. 

One further implication for teacher education arises from 
this project. Supervisors of pre-service teachers should be able 
to provide much more penetrating analyses of teaching if they, 
too, make use of data from behavior^* 3 indicators of pupils 1 
cognitive mediations, Such data about: teaching will help to 
anchor suggestions for improvement, as well as describe the degree 
of "instructional rapport" that heretofore has been described less 
directly by high-inference ratings of pupils' involvement, engaged 
time, and interest. 
Implications for Teachers 

Because of the newness of cognitive mediational research on 
teaching, it is likely that practicing teachers probably are not 
much more informed about this view than are pre-service teachers 
other than intuitively by virtue of their experience. Therefore, 
it seems reasonable to expect that the implications just mentioned 
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for teacher education generalize to practicing teachers* Two 
other implications can he mentioned for teachers. 

A review of in-service programs by Joyce and Showers (1981) 
showed that teachers are much more able to practice newly acquired 
skills and strategies when chev receive support for doing so (what 
these authors labels ,! coaching M ) * If, while trying out new 
t each ing me thods , .can. J,nvo^ve- Cheir^pup^U^^y— having^CRl'tfr 

generate behavioral indicators of cognitive mediations s pupils may 
he able to be the best coaches^of all. They will know whether 
they are confused , or whether a new procedure clicks for them. 
Hence* by taking both explicit and operational account of 
students 1 cognitive mediations of instructions teachers may be 
able to obtain the most relevant and timely coaching possible for 
practicing new teaching methods* 

The second implication of this proiect for teachers concerns 

remediation and individualization. Explicit consideration of the 

kinds of cognitive mediations students employ can serve two 

purposes. One of these is to help the teacher pinpoint 

instructional stimul i that students are misinterpreting. By 

supplementing regular teaching with training procedures like those 

we used in Studies IT - IV, these difficulties may be lessened or 

eliminated. The second purpose that can be served is that of 

matching instructional delivery to particular cognitive 

mediational strengths that students may exhibit. Following this 

suggestion might mean that^ at specific points in lessons 7 a 

teacher would provide alternative instructional stimuli to 
different groups of students. Combinations of these two 

approaches should help the teacher to deal more effective Iv with 

the range of individual differences that any group of students 

presents* and to capitalize on cognitive mediational strengths 

that might exist in a class. 
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